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ABSTRACT \ , ^ 

This second issue of "Investigations in Science 
Education" (ISE) , designed to provide a new perspective for viewing 
research articles and to aid in the improvement of, writing research 
reports, includes abstracts prepared by science ediicaf'ors, 
bibliographical data, purpose , rationale, research Resign and 
procedure, findings and interpretations as well as. detailed notes^ 
offered by the abs.tractqr . The analyses are intended to provide 
useful comments and suggestions to serve as a device .Which might be 
useful for training in the writing of research articles. Articles 
included in ISE are selected primarily from such sources as 
professional journals and reports of gov.ernffient-f unded v pro jects*> 
Abstracts included in this issue relate to topic areas Such as 
evaluation of children's performance on the cognitive, af^ectiye and 
motivational domains, student perceptions of teachers, evaluation of 
student laboratory reports, effect of behavioral objectives, and 
;comparison^ of instructional strategies.- (EB) 
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NOTES . . i 



from the Editor ' , " 

' ~ ' T"' /- 



Each research report revieyed in Investigations in Science 
Education vill include In the citation the ERIC Descriptors assignibd 
to th6 original doc'umentiwhen it was processed into the ERIC system. 
The readerSho is interested in a particular area Represented by a 
reviewed reportSan locate other documents *^ich may be related b^ 
searching the ERlC^data base with one or more of these descriptorts . 
Identifiers, which-are assigned to some (tut not all) documents, 
are terms which are not^a part of the standard ERIC vocabulary but 
are in common usage in some segment of the educational community. 
These terms may also be used to search the ERIC data base for 
documents related to these special* topics. 

Because one of the prime concerns of . Investigations iR Science 
Education is to promote better research reporting, copstructive 
dialogue within the science education community is encouraged. 
Accordingly, publisljable letters of resiyonse to the abstracts and 
analyses are Invited as well as are suggestions for improving the 
content and format of Investigations in Science Education. 



Stanley L. Helgeton 
Editor 

*« 

Patricia E. Blosser 
Associate Editor 
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Allen, Leslie R., "An Evaluation of Children's Performance on Certain 
Cognitive, Affective, and Motivational Aspects of the Systems and 
^Subsystems Unit of the Science Curricultm Improvement Study Ele- 
'mentary Science Program." Journal of Research in Science Teac hing. 
JloX. 10, No. 2:125-134, 1973"; 

Descriptors— *Academlc Performance, *Behavloral Objectives, 
♦Curriculum Evaluation, Educc^tlonal JResearch, Elementary School 
Science, *Intellectual Development, Science Education, *Sclenti{ic 
Literacy ' » 

Expanded Abstract and Analysis Prepared Especially for I.S.E. by 
Kenneth D. George, University of Pennsylvania. 



Purpose . ' 

The purpose of this study was to evaluate whether participation in 
the Science Curriculum Improvement Study (SCIS) Grade three unit. 
Systems and Subsystems, resulted in performance superior to those 
children who did not participate in the program. 

Rationale . ' 

The* investigator has previously evaluated the SCIS physical gCience 
units in grade one (Material Objects) and in ^rade two (interaction) . 
This present investigation is part of a larger study that will even- * 
dually evaluate all physical Science units of the' SCIS program. 



Research Design and Procedure 

The experimental (N • 37) and control (N » 89) groups ware in the 
third grade and were the same children who 'participated in the first 
and second grade evaluations: Bdth, groups were further subdivided by . 
sex and socio-economic status • The investigator developed six sets of 
items to evaluate five objectives from the System and Subsystems unit: 

identify variables that miy affect the operation of a 
simple mechanical system; i 

plan an experiment in whlc^only one variable is changed; 

make predictions based on existing data; 

analyze data represented on histograma; . ^ 

recognize changes that occur during an experiment^ 

£ach of the subjects was individually ei^uated on the six sets of 
items, average time p6r subject* was 25 n^iutes. 



1, 

i.' 

*3. 
^ 4. 
5. 



Finding! 

1. There appeared to be little difference between. SCXS and non- 
SCI5 children In ri^spect for their preferences for school 
subjects. • . . » 

2. SCXS children consistently outperformed mon-SCIS children In 
handling and manipulating the materials placed In front of 
them by the examiner. 

y 

3. SCIS children aske^ more questions and made more statements 
about the activities than did non"*SCIS children. 

4 1 For the sissies t. respimse category (naming of objects) the 
^ performance of the two groups was almost Identical. For the 

more "sophisticated response categories/' ^CtS children out- 
performed non-SCIS .children^, ^ . . , , 

5. .For all situations presented, the SCjlS group was able to . 
suggest a greater number of relevant, possible variables than 
\fMB the non-SCIS group, • 

v6. SCIS children provided* more correct answers than did non- 

SCIS children when asked questions dealing with (a) prediction 
from existing data, use of experimentation to obtain new data, 
^and (b) Interpretation of data from histogram. 

7« SCIS children seemed to be better observers of change than non 
SCIS children. 

8. The respoiises on the first five sets of Itema (25 questions) • 
'irere Inter correlated and faclEor analyzed. Three factors were 
extracted : 

a. motivation to explore, by handling, the object 
presented; • ' 

"< 

«- b. recall or. recognition of knowledge* and the 

development of : Intdllectual skills (cognitive) ; 

^ . . c. motivation to ask questions, or make statements, 
'- " " about the i>b^ect« pr ei(ented.«^ - - 

SCIS children showed* a significant difference on the first two factors: 
mo tlvatioi^'<, (exploratory) and ^cbgnitive. 



Interpretations 



The significance will be examined and presented at^the conclusions 
of the six-year study.* ' ' 
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• Abstractor's Notes 

• 

1. * A description of the population vas Included In previous 

articles so that the reader woifld have to review ^Jj*??^ 
before reading this artlclo. 
« 

2. Did the control group have the same five objectives In Its 
science program as did the experdbtnental group? ' 

^3. If the six sets of Iteias were specifically prepared from 
" the Systems and Subsystefos unit, didn't these Items favor 
the SCIS group?* 

4. How vas the validity of the Items determined? What vas the 
-reliability of the Items? 

5. Hov long did the children study th& System and Subsystem 
unit? Did the control group have as many contact hours 
with science as did the experimental group? 

6. Was the Instructor the s^one for both groups? If not, how 
many instructors were Involved? 

7. Who did the individual testing cxf the chlldreb? Was It the 
.same person? If not, were. their observations reliable? 
Were instructions given to the evaluators in order to assure 
valid observations? 

8. When was the evaluation done? A simple calculation indicates 
over 73 hours of testing. What was being done by the children 
in the groups 'during this time? * Wero the children selected 
randomly for testing? If not, was one group tested firat? 

9. Most important, did the evaluator(s) know if th^ children 
were in the control group or in the experimental group? 
If so, how does the reader' know there was no bias on the 
part of the . evaluator? 

10. What were the Implications and inferences the Investigator 
arrived at upon the completion of this study? 

11. It is hoped that in publishing w results of the evaluation^ 
to be done in the fourth, fifth, and sixth grades, the 
investigator will attempt to include the answers to the 
questions posed aboye. 
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Boyd/ Eunice mnd Kenneth D. George, "The Effect of'science Inquiry 
on the Abstract Categorization Behavior of Deaf Children." 
* Journal of Research in Science Teaching .' Vcvl. 10, No. 1:91-99, 
1973. , » 

Descriptors— '^Claasificmtion, *Deaf Children, Educational Research 
♦Elementary School Science, 'Handicapped Children, instruction, 
Science Education, *Sensory Experience 

Ejcp'anded Abstract and Analysis Prepared Especially for I.S.E. by 
V Ronald G. Good. Florida State University. 

Purpose r . . J ' 

The purpose of this research was* tJ0 investigate whether or 'not 
;^signif icant change in the level of categorization of the deaf 
^tthildren in the experimental group could be achieved through partici- 
pat^pn in a series of experiences in manipulating objects. 

If categorization in the deaf is tied to language, itp pro- 
gressive development would be dependent dn the development of language. 
No rapid change in categoriza^:iopJbtchiW]ior could be expected, because 
the attainment of language 16 / slow aiAj laborious achievement tor 
the deaf. If experi^ce is k critical factor in the development of 
categorization skills, a comitensator^^^jjfogram of experiences, specif- 
ically Structured toward the? diualeiJment of classification skills, 
could be expected' to effect a rapid change in categorization behavior. 
This latter hypothesis formed the basis of the study. * * 

Rationale ^ / 

/ . • 

Piaget, s cognitive theory posits the roots of intellectual de- 
velopment in the direct manipulation of the environment, not in the 
verbal symbol. He supports his theory that the basic cognitive 
structures are derived from actions with the observation that young ' 
children classify manually btfore they can classify linguistically. 
The difficulty deaf children experience in the attainment of abstract 
thought may be related to a dearth 6f experiences in tlie manipulation 
of objects, experiences familiar to hearing children because of the 
stimulation of verbal communication. V 



Education of the deaf gives almost exclusive emphasife to the' 
teaching of language (5,7,10,12,13),. Regardless of the effort exerted 
in this dlrjjction, the great majority of the profoundly deaf popu- 
lation never achieve the minijnum criterion of linguistic competence, 
defined as the ability to comprehend and construct grammatipally 
structured sentences (8). This MiiJblnation of circumstances^^ the 
inability of a large segment of tH^^s^eaf population to achieve lang- 
uage competence and the retardation the deveiopm^t of abstract' 
mental process in the deaf, invites the investigation of a pedagog- 
ical approach to the education of the deaf th^t ^tresse's^ sensory 
experience rather than language attainment. ' 
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The goal of science *edu cat Ion as the goal of the education of 
thd deaf Is the development of formal thought (1,2,4,6,8,11). Man|p 
science educators' consider the most effective means of achieving this ^ 
goal to be. through inquiry. Though inquiry may be >li5f ined in many 
ways, JLt is liere defined as that mode of lemming whereby one dis- 
-covers rel^ationships through his own activity. This activity may in- 
volve physical 4nteraction with* the things of the environment or 
mental manipulation of conceptual schemes, depen'dl^g upon the fntel- 
l.ectual maturity of the inquirer . / 



Research Degign and Procedure 

Students of the Archbishop Ryan Memorial Institute for the Deaf 
in Philadelphia, between the ages of 10 and 13, were the subjects 
of, the ^tudy. The lower limit of the age range was set at IQ be- 
cause even under normal conditions, abstract classification skill 
does not usually mature before thdt age. All the children in this 
investigation were of normal intelligence, ^ls measured by the Kuhlman- 
Finch Scholastic Aptitfide Test, and had incurred deqfneSs by the 
second year of life. The 26 children who met the criteria for selec- 
tion were randomly assigned to an experimental and a control group. 

The pretest-posttest dontrol group design was used. Dual forms 
of the Golds tein-Sherrer Object Sorting Test were used to minimize 
pretest influence on post^e^t performance. Three cognitive styles ^ 
are identified by the test: *{X) concretistic, a mode of categorizing 
that distinguishes relationships among environmental stimuli through 
external features, such as spatial and temporal contiguity or per- 
ceptual similarity; (2) functional, mode of categorizing based on', 
the external feature of use; (3) conceptu^, the abstract mode of 
categorization, based on intrinsic attributes and essences. 

Experimental treatment consisted of participation in thirty 
30-minute sessions of science inquiry, structured toward the develop- 
ment of classification skills, and based on the physical manipulation - 
of objects. -The lessons were planned with the Under lylpg assumption 
that the deaf child is different only to the extent tha.t insuff ici^ent ^. 
environmental stimulation has made him so. He knows his environment 
mainly through sight, smell, taste, and touch. Unaided by the cate- 
gorical patterns imbedded in verbal language, he orders envirjomental 
input by developing hi& own unique system, of categories. The 30 
sessions, developed and taught by oi^ of the investigators, presented 
a structured experiential introduction to elementary classification ^ 
schemes. # « , ^ 

^ The sessions were held in a laboratory-classroom that was well 
Equipped for inquiry. An effort was made to sustain an atmosphere 
o| freedom and informality » The children were free to move around 
the room, ^se. the available equipment and resources, ^d test m£^terials 
as they wisjied. A free flow of communication was maint£^ined between 
student and student, and between teacher and student*. 

Each of the inquiry sessjions was 30 minutes in length* The 
entire program extended over a 10 week period. The control group 
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followed the regular science curriculum of j.the school for an amount 
of time equal to that used by the 30 inquiry sessions. . ^ 



'Findings ^ , * ^ ^ 

.One null hypothesis was tested by the research: Participation 
in specjLfic science inquify will cause no signif leapt change in the 
abstract categorization behavior of deaf children, as measured by 
the Golds tlhe-5l^/65irer Object Sorting Test. f * 



The two-tailed test was used and the five percent x^^l was 4 
selected as indicative Of significance. Although the study was focused 
on changes In abstract (conceptual^ categorization, an^ysis of funcr 
tional and concretistic categorization was made for comparative pur- 
poses . V 

The -results of the factored analysis lead to the following ^ 
, conclusions : 

. \ . 

(1) The initial \i^fJ^erenoe between groups had no signifi- 
cant influence in the final' difference between groups. 

(2) The fiest itself was a significant factor (educatlveO in 
the post test change demonstrated by the experimental 
group, - * 

(3) The experimental treapoent effected a significant in- ^ 
fluence on the pretest-post test change in the con^ 
ceptual^ categorization behavlbr of the experimental 

^roup beyond the change effected by the educative 
influence of the pretest on th^ post test performance. 

The results of the factorial analysis of the experimental data 
Justify the rejection of the null hypothesis that was tested. The 
results of the analysis demonstrate a significant 'change in the level 
of categorization uSed by the deaf diildren in the experimental group ^ 
This indicates that sensory experiences may be the critical factor in ^ 
the development of categorization. ' • 

Interpretations ^ ^ ^ 

The analysis of pretest and post£est data indicate a sJ^gnificant 
change in (Compliant categorization behavior of ^ )the experimental group. 
The developmental gain was achieved thi^ugh a program of experiences 
in manipulating objects. Furtl)'s postulate that the deficient clmssi- 
flcatoty J)ehavlpr of the deaf is the Result of Experiential restric- 
tion in early life is clear ly supported by the resultti of this study • 
(3). ^ 



The significant difference in conceptual categorizing 'behavior 
achicf^d by the experimental group^ is attributed to exposure to 
opportunities that encouraged the development of new conceptual cate- 
gories. An examination of the inquiry program designed for the study 
reveals a strat*egy of continuing cha}.leng& of existing mental 
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structures. This Is a function of cognitive socialization that 
rarely reaches the deaf child In his dally life. A hearing child's 
emergence' from egocentrldty to socialized thought Is stimulated by 
a gradually developed awareness that there are other ways of viewing 
the world than his own (9) . The. cognitive socialization of the de^ 
child is blocked by his inability to exchange viewpoints wilh the 
outside world. He can become locked into primitive coding techniques 
because their inadequacy remains unchallenged . The results of this 
study suggest that the diminished^ ef f ectiVQne?a of cognitive sociali- 
zation in deaf children cazi be co^ensated» at^ least to a limited de- 
gree, by exposure to specifically structured experiential programs 
designed to challenge sublogical cognitive structures. \ 

Abstractor's Notes 
—% 

The authors seem to have established a* definite link between 
manipulative opportunities for deaf ch4>ldren and subsequent scores 
on a test of classification ability. If, in fact, there i's a causal 
relationship between certain types of manipulative activities by 
deaf children ^d their development of "abstract categorization'* 
abilities, then the implications for curriculum decisions are clear. 

The authors noted that the acquisition ofylanguage by. the deaf 
may be related teethe development of categorical (classification) 
ability. Thl^ possibility certainly deserves serious study and is 
consis.tent with the viewpoint that language can reflect developing 
cognitive structures. ^ 

^e aspect of the authors' research ^ich ahoxxld be considered 
is the nature of the treatment.* A general description of the "science 
inquiry" experiences was given for the* experimental group, but the 
control group was described only as following "the regular science 
curriculum." # Without some quantified description of the "regulat" 
science curripartCumT^^J^ is left with many questions about just what 
it /was that was being researched. The words "science inquiry" and \ 
"rlgular science" have such diverse meanings that they do not really , 
coidfcunicate with a great deal of clarity., Por a study to be repllcable 
the classroom conditions for both experimental and control groups 
must be unambiguously comsninicated. This is a criticism that can be 
applied to a great many classroom studies which are reported in the 
various journals. 

In considering reasons for the slower rate of cognitive growth 
for deaf children, the authors suggested that reduced sensory input 
causes inadequate "cognitive socialization." The deaf child is less 
able to "exchange viewpoints" with the environment and thus has less 
of a need t6 revise existing mental structures to better "fit" that 
environment. A school curriculum which is centered primarily around , 
language experiences tends to compound an already difficult situation 
frfr the..deaf child. Hearing is not needed, however, when the child 
interacjte with manipulative materials and so the physical disadvantage 
of the ?iftf ^child is minimized. "Cognitive conflicts," which tend to ^ 
promote the development of new mental structures, can be %uilt into" 
sets of materials for all children. 



The authors' statement that deaf children cap become locked 
into primitive coding techTiiques because their inadequacy remains 
unchallenged" has important implications* for searching out ways of 
challenging these children. Regular language-based ijeans for helping 
children intO|(Cognitive conflict situations are even l&ss effective 
than usual, when the sense of hearing is inoperative. 

, Results from this study tend to support the contention that 
cognitive growth is mainly facilitated through a child's actions 
rather than words. Interesting theoretical questions are raised 
concemlng^he relationship between the deaf child's cognitive growth 
and his/her^aoguage development. Further work is needed to explore 
this relationship and to determine optimum learning environments for 
children with restricted sensory input. 

Results^ from J^iis study tend to support the contention that 
cognitive growth is mainly facilitated through a child's actions 
rather than words. Interesting theoretical questions are raised 
concerning the relationship between the deaf child's cognitiv^e growth 
and his/her language development, Purthei^ work is needed to explore 
this relationship and to determine optimum learning environments 
for children with restricted sensory input. 
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Bybee, Rodger W. , "The Teacher 1 Like Best: Perceptions of Advantaged, 
Average and Disadvantaged -Science Students." School Science 
and Mathematics , Vol. 73, ^o. 5;38A-390, May, 1973. 
'Descriptors— Attitudes,, *Educational Research, Science Education, 
Secondary School Science, *Student Attitudes, Student Opinion, 
*Teacher Behavior, *Teacher Characteristics, *Teacher Education 

Expanied Abstract and Analysis Prepared Especially for I.S.E. by 
Robert E. Ziegler, Elizabethtown College. 



Purpose 

The author of the paper, Rodger Bybee, is proposing that during 
the development of science education programs at colleges and univer- 
sities a variety of in-put s be considered. The usual mix is composed 
of the present curricular materials and the experiences and percep- 
tions of the course developer. Another in-put is being proposed from 
the consumer, the high school student. 



Rationale 

It is felt* by the author of the paper that the perceptions of 
the high school students, who will be taught by the "products" of 
teacher training institutions, should i>e considered and reflected in 
the teacher training program. Three ^r6up8 of students characterized 
as advantaged, average, and disadvantaged rated five teatiher char- 
acteHstits in a preferential order. The ranking of the character- 
istics indicates that, among the studentSi interpersonal x;elationsbips 
rank the highest within the framework. The Teacher I Like Best. 

This study is related by contrast to a study by Fox and Hein 
that indicates college faculty perceive professional qualities high- 
est while interpersonal relationships were the lowest. 



Research Design ancf Procedure 

Three high school student populations were given a 50 item Q*- 
sort. The populations were characterized as advai^aged, average, 
and disadvantagefl. The advantaged group was composed of 31 students 
from the Frontiers of ScienceVlnstitute at the tJniversity of Northern 
Colorado. Th&Average group was composed of students from the 
Laboratory Schbol, l/niveraity /of Kor them. Color ado. The disadvantaged 
group of 96 acudents was compjbaed of two populations of Upward Bound 
students, onfe at the University of Northern Colorado and the second 
at temple Buell College, Denver, Colorado. 

The 3b item Q-sort was arranged into five major categories 
with 10 SUA- categories under each. All of the categories and sub- 
categories except teaching methodology had been shown to be repre- 
sentative of teacher performance and wer6 positive in reference to 
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TAILS It COHPAAISOM *0r SITPOrr POmATION 
BaU «r« KaporUd la ATer«|it for fo^uUcioo 
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Crsdc Foiac AvcrAgc * 
la Science 

(4 points Ij hlfh) ' 
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2.. 
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TAthsrIs 'iduCAtlon 


SOQ* 

blfh School 


Gradustsd 
f row ColI«f« 


Graduated 
fro« College 


Hothet's ZducAtloQ 


Spve 

Bifh School 


SoM Coll«s« 
or Trad* 

School 


Soae Collefe 
or Trade 

School 



teacher behavior in a study by Cosgrove (1) . On the (J-sort each item 
waa preceded with: The Teacher I Beat. 

Administration of the (^-sott waa completed in two stages: first, 
the sttidents were required to sorrf the itema into three groups, eaqh con- 
taining approximately the ssme nuoBer of Iteaai. The three groups were 
.identified aa' positive (17 items) /neutral (16 items), and negative (17 
items). Second, these groups were further separatetl into saven cate- 
gories: Mostly strongly agree (2), strongly agree (6), Iqast strongly, 
agree (12), neutral (10), least strongly disagree (12), atirongly disagree 
(6), most strongly disagree (2), Each category was allowiifi the number 
of itema indicated in the parenthesis. The items were placed in. envelopes 
indicating the category and number of responses allowed. Only acceptable 
student z^sponsea were analyzed, incorrect responses were rejejited ^rom 
the statistical analysis. « 

The results of the study indicate ail groups of stw^^^ts fadvantaged, 
average and disadvantaged) rated adequacy of relations with students in 
clasa and anthusiasm in working with student^ as tht> top' items. All 
students" ranked Teaching Methodology last. Tablj>j'l3 'presents a summary 
of the results. 'K 



U 



ERIC 



17 



4 



TABLE II: RAHKINC OF TEACHER CHAIACTEMSTICS BT 
SELECT GXOU?S OF SECOHDAIT SCBOQL STUDENTS 
D«t« «r« R«port«d by lUnk tad Ajr«r«t« 
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Frontltrs of » 
Sclsoct 
$titdsots 

H-31 


Iftilvtrslty 
Bifh 
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Studtnts/ 
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Upvard Bouxid 
Stud^ntt/ 
Dtnvtr 
K-56 




KoQvltdst ^=tad 
Oxt«nfkttioQ of 
SubjWct Matttr 


3rd 

• (3.874) ' 


3rd 
(4.004) 


4th 
(4^698)^' 


4th 
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2. 
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Xelatldos vitb 
Students in » ^ 
Class 


(3.397) 


1st 

(3.336) 


1st 
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1st 
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Flsxu sod 
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CUss 


4th 
(4.461 


4th 
(4.348) 


3rd 

(4.371) \ 


3rd 
(4.209) 


4. 


EntbuslAsa Ia 

Vorklnt vltb 
Stxidsots 


/C3.129) 


' 2ad 
- (3.373) 


2sd 
. (3.326) 


2nd 
(3.450) 


5. 


TsscMng Usthod / 


3th 
(4.961) 


5th 
(4.973) 


5th 
(4.724) 


5th 
(4.920) 



Interpretations "^^ 

# • ^ ^ • 

Most programs for thje preparation of science teachers emphAsize 
knowledge of subject mattery ability to plan and prepare, and methods of 
teaching. The rankings of these students indicate that the characteristic 
of primary importance to them is interpersonal relationship?. Development 
of interpersonal relationships has been assumed in programs and therefore 
not emphasized. §ince teachers and students enter the classroom with 
conflicting ^perceptions, discord develops. The stated conflict should be 
confronted and attempts made to establish a higher cofrelation between 
the perceptions of the two groups'. 



Abstractor's Notes 

The classification of students Into categories such as adiyantaged, 
average, and disadvantaged is difficidt any time. With a limited popu- 
lation of stxidents available for this study, it is even more difficult, w 
Therefore, it seems questionable to designate, thla group^ a **crosi-section*^ 
of secondary students. It seems highly questionable to classify the 
University High students as average vhen one views the family income or 
educational achievement of the poirenta. 

The procedures for the students to follow appear to be rather diffi-, 
cult. Of the 50 items in the Q-sort, 40 had been previously designated 
aa positive. With this being true how can we expect students to rate 
fthe 50 items positive (17 items) , neutral (16 items) , and negative '(17 
items)? Following this original division the students are then required 
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to arrange items into seven groups vd.th a designated number of items in 
each group. The author states that incorrect responses were rejected 
tfi^ the statistical analysis which seems to reduce further the "cross- 
section** quality of the study. 

**The Teacher I Like Best** certainly connotes per&onal qualities, 
therefore it isn* t surprising that the categories rated most highly re- 
flected/personal qualities. If the prefix had been stated differently, 
such asL "The Teacher From Whom I Lelimed The Most," the results may also 
-have beeh. quite different. 

In ths later part of the paper the author contrasts the perception 
of the students with the perceptions of faculty mejnbers in the study by 
Fox and Hein. It seems difficult to cTompare these studies when the pre- 
fixed statements for the two groups are different, "The Teacher I Like 
Best** and **Effective Teaching." 

Learning frequently introlves human interaction and therefore Inter- 
personal relationships do need to be emphasized in .teacher prep'aration 
programs. 
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Cohen, Ronald D., "Eva^uation^ of Student Laboratory ^Reports Under a 
Schedule of Partial Reinforcement."^ Journal of Research .In 
Science Teaching . Vol. 8, No. 2:185-189, 1971r . ' 
Descriptors — Classyodm Research, *Educational Ps;^chology, * / 
' *Grad±ng, *Leaming^ *Rej:nfortement , *Secondary School Sciefice 

' i 

Expanded Abstract and Ana^si^ Prepared Especially fct I.S.E.'by 
Robert G; Bridgham, MichiSirstate University. 

Purpose ' . ^* * . K . ^\ ^ 

This' inve«td.gation focyscd on Vhe^ther the acceptability of 
stjudent labqyatory, r^orts vill cliange when^only a randomly chosen • 
'25 percent of the reports ^ are graded. ^ » ' ^ ' 

' *• , ' % . • *• 

• *. ^ 

Rationale » " , * " ' c . * . ^ • ' . ' 

•tHfi tr^ve*stig«tion was guided a metaphcT^ dralra from stimulus- 
response learning theory. Jn many studies (primarily of animals 
crtKer th^ man) it has been ofeft^^st rated' that performance can be 
maintained by providing relevant r^inf or cement ^ sporadically, rather 
bhan*" cdntinuously. , For example, ^Ferftter ahH Skinner "in thejr 
Schedules of Reinforcement (Appleton-C^tury-Crof ts: Nev York, 1957) 
report a'Tlc;>i.yafiety of.s^ttidles in support 'of this printipl^." In 
the current tnV^atlgatiop - the perfprmancel t^ be maintained is pro- 
duction pf aii acceptable^ laHor at ory rfepiHrt/ The re itif or cement ^Is 
thought 'to^bc' recej?tlon.of a grade on the laboratory report. . 

Resea^cH Design and Procedure 

the group studied consisted of the 4^ stii^Ients in two Classes 
of an elective ninth gxa^Ie sclente course.^ The science course was 
av^lable only to students with a grade pf "C** or better in eighth 
gfade science and permission of the eighth grade science teacher. 

During a preliminary ten week peripd students were trained to 
write accept;able laboratory reports.' Eight laboratory reports were 
assigned during the ten weeks, and all were graded* Any report that 
was not ^c^ceptablepwas returned to the student, who was told to re- 
vise the^ftport and hand It in on' the next day If he wished to re- 
ceive ,^|dit. . ' ^ 

In the next four weeks four more laboratory reports cane <lue. 
One class (A^ with 25 students) continued to have each laboratory 
report graded. The H>ther class (B, with 23 students) was told that 
each laboratory report would be collected according to the normal 
schedulft, l}ut that when four reports had bben collected, one would 
be selected at random. to receive a grade. /The grade assigned to 
that one report would be multiplied by four and would count as the 
grade for all four laboratory reports « A separate random selection 
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would be made for each student. The investigator recorded the number 
of acceptable laboratory reports submitted by each student in both 
classes. > « , ' 

In the next four weeks fbur more laboratory reports came due. 
The grading schemes used in the^ two classes were swapped, with class. 
A receiving grades by the random one-in-four scheme aSid class B hav- * 
ing each laboratory report graded. Again the investigator recorded 
the nuitiber of , acceptable laboratory reports submitted by each student. 

At no time during the study did the teacher-investigator indi- 
cate that a formal inquiry was underway. Changes in grading pro- 
cedure were explained as something the teacher wanted to "try out," 

For bhe analysis, each class was divided into two groups. One 
group included all those whose laboratory reports were all a(;/:ep table 
during .the prejiminary ten weeks; the other group included all those 
who submitted one or more unacceptable x'eports during tfhis period. 
Roughly three-quarters of the students in each class fell into the 
•^irst (all acceptable) group, 

, The effetts of the experimental treatment (one-in-four grading) 
were analyzed in a set of two-by-two contingency tables. Each table 
showed the number of acceptable vs, the number of unacceptable lab- 
oratory reports for students who had each laboratory report graded 
and fot students who had only a ran^pm fourth of tl}eir< laboratory 
reports graded. Four contingency tables were constructed: one for 
the first experimental four week period included the students whose ' 
laboratory reports in the preliminary ten weeks had all been accept-^ 
able; another for the first experimental four week period included 
the students who submitted one or more xmacceptable laboratory re- 
ports in the preliminary ten. weeks; one for the second experimental 
four week period included the students whose laboratory reports in 
the preliminary ten weeks had all been acceptable; another for the 
second experimental four week period ix^cluded the students, who had 
submitted one or more unacceptable laboratory reports in the pre- 
liminary ten week period, 

Chi square was computed for each contingency table to deter- 
mine whether the frequency of utfacceptable laboratory reports was 
associated with the gr^aS^g. scheme used, 

^ Findings ■ - 

None of the fot3kr chi square values computed was large enough 
to approach stAtistical significance. The repotted chi square values 
were each leas than one. 



InterpretatdLons . • " 

The investigator concluded that "once a leVel of acquisition is 
reached, it is not necessary for a teacher, to grade each re^'onse 
submitted by ibis students in order to maintain the same level of 
response." He notes that thQ results of the study are consistent 



wi,th the findings that l^ave pjersist^ntly appeared in studies t>£ > 
partial relnfprcement schedules. He aiisa sugg^ts thit confidence 
In the genexalizablllty of the study's findings may.be limited by 
the nature of the sample and by the limited tline period of' the study- 
(four veeks of the exp^lmental condition) , He comnents qn th<? .dif- 
f^rence between "acceptaUHlty" and *>^quallty/^ and, on the, difficulty 
'of defining specifically what,wa^ relnf6tclng .in the complex of 
student behavior and teacher response that leads to the assignment 
of grades* ' 



Abstractor's Notes ^ 
How far can the findings be generalized? 

AiJaong the factors that may affect our willingness to generalize . 
' from thi? study are the followingi A) the connection of study results 
to well-established theory, BX Idiosyncrasies in* the group or sltu-zf^ 
atlon studied, C) errors in design, execution, or reporting, and J 
D) inadequate .informatloii about important aapepts q€ the ^tudy. ^ 

A) The connection of study tesults to well-established theory * 
Jf a study's remits can be interpreted in.terpis of a well-established 
principle or law, we can usually generalize fxOTi the study with jnore 
assurance. We are likely to be 9uffpiclous of generalizations, to 
areas where the principle has proven Inadequate and confldeot of 
generalization to areas where the principle has demonstrable explana- 
tory and predictive power. The principle of partial reinforcement 
has notr to my knowledge, proved inadequate in any situation yhere . 
performance, reinforcement, and the contingencies linking performance, 
imd reinforcement were well-defined. Thus^ if the current study can 
be clearly connected to the principle of partial reinforcement, we 
should be able to generalize its findings* with confld^ce. Unfor- 
tunately, the liiUcage isn't clear. ' . 

If a high ability student receives a low grade on a laboratory 
report lA reinforcement being provided? The analysis and documenta- 
tion provided by the investigator does not clearly establish that 
the receipt of a g^e is reinforcing. Indeed, the freqtiency of 
acceptable reports in the second^ experimental four, week period is 
significantly lower than that in the first experimental four week 
period. Apparently neither "reinf credent" regime is adequate to 
maintain the desited student performance. Since what defines a 
,rein for cement is its power to medntaln performance, grading may not 
be reinforcing. Thus, it may be inappropriate to put nwch weight 
on the resemblance of this study to studies of the effects of partial 
reinforcement; it is not clear that the relevant reinforcements it ^, 
the situation have bee^ identified and experimentally manipulated. 

J* » * 

B) Idiosyncrasies in the group or situation studied - If we 
cannot use well**established theory to guide generalization, 
are left with using our general knowledge of affairs to nsaeaa how 
far the findings of the study can be generalized. The fact t^iat 
those students were average or above in science achievement and had 
elected the course becomes more crucial. If the results are trust- 
worthy, they can probably be generalized to most other situations 

♦V 



In which students are able and Interested. It Is not clear that the 
results can be generalized to njore typical classes - those that are 
more varied In ability or that contain sftudentp ^th les9 interest or 
motivation. The limited time Span of the investigation may be less 
critical since there was no iudication that the effects of sporadic 
grading were shifted any more or less by the passage of time than 
were the effects of continual grading. ' ^ \ , * 

C) Errors in design^ execution, or reporTlag Whether or not 
the f indlnga can be generalized becomes moot if the f lndlp|iB* are 
untrustworthy. Are there missteps in the ^tudy or in its ^eportin^ 
that would make us skeptical of the results? jTie Investigator chose 
the wrong statistical test. A chl square test is ftuppropriate when 
any cell in a contingency table has an expecUS v^ye less than five, 
and each of the contingency tables in this study has such a cell. 
However, use of an appropriate test - Fisher ^ct test - doesn^t 
change the findings, so this error is of no consequence. More .troub- 
ling is the afriaience of data for one student, frotiv the data tables. 
(Data corresponding to 47 students are presented, but, presumably, 
48 students were Involved in the study). Since the reporting is 
otherwise meticulous the discrepancy is probably a harmless oversight, 
though it is disconcerting. There, sefems to be no strong reason to 
doubt the trustworthiness of the findings. 

0) Inadequate information about important aspects of the stQdv - 
One problem in generalizing the findings of the '^fudy is that we are 
never told what made a laboratory report unaccefptable. It is made 
clear that "acceptability" is different from "quality." Since quality 
is usually judged on the substantive content of a report, we might 
guess that acceptability involves a judgment about the presence of 
freqd^red elements in the report (e.g., are procedure?, observations 
presented, conclusions -drawn?) Howeyer, we don't know ^h at standards 
for acceptability the investigator ai>plied. Cpnsequently we cannot 
be confident that ve can expect similar results when we apply our own 
stiandard^ for acceptability. * 



Summary for generallzlbllltY - If we could replicate the investi- 
gator's standards for acceptability and if our students were able and 
Interested in their studies, we would probably get similar results 
from sporadic grading of student's teports. Our ability to generalize 
with confidence is limited by uncertainty , about what is meant by 
"accelptablllty." It may alsp be limited by the rather special natute 
of the student grbup studied. 



What is the educational relevance of tha-atudy? 

A^ first glance the findings of the 'study seem to promise much* 
It appears that we can maintedn the existing quantity of student work 
with less work by the teacher - a technological breakthrough. Alter- 
natively '(although this wasn't investigated) the study suggests that 
with tiieisame effort that teachers now put in, we might be able to 
get more york |rom students. ^ 
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Most often, though I it is not the completion of work Iti some, 
formally acceptable way that ia educational^ly^ relevant. A student 
might produce a formally acceptable laboratory report or ^essaf or 
problem solution that is riddled with misinformation or misconception. 
Students' work iiB an occasion for reinforcement: it is, more impor- # 
, tantly, an occasion for te^acheX assessment of what students know ^nd 
are able to do and of the corrections of student performance an^ 
teacher planning that follow f rom^ the assessment. 

While the kind of grading scheme described by »the investigator* 
may maintain the level of student work with less, teacher effort, it 
cuts down the possibilities of educationally- beneficial responses 
to student work. It does this by increasing' the time, on average, , 
between student completion of v^^k and the teacher '8 'response to the 
work. It also permits most atudent errors an^ misconceptions (those, 
in the three quarters of the work that is not graded) to go un- 
challenged and uncorrected. 

Since it is the teacher's response to student work that is most 
likely to bring educational benefits, and, not the work by itself, the 
technological breakthrough suggested by this study is more apparent 
than real. * 



ERIC 



E^.079 472 ^ 

Gatta, Louis A., "An Analysis of the Pass-Fall Grading* System as 
Compared to the Conventional tSradlng System In High School 
Chemistry . " Journal of Research- In Sfclence Teaching , , 
Vol. 10, No. 1:3-12, 1973. / . 

Descriptors — ^Academic Achievement, Chemistry, Educational 
Research, ^Evaluation, *6radlngi ^F^sa^Fall Grading,, Science 
Education, ^Secondary School Science, Student Attitudes 

Expanded Abstract and Analysis Prepared Especially for I.S.E. by 
AnnC.^ove, Sytacuse^ University'. 



purpose 

The purpose of the study was to compare the effects of the con- 
ventional five-point grading system and the pass- fall system on 
' (1) student achievement and (2) student attitudes In chemistry at 
the secondary level. The teaching practices and techniques used by 
teachers In the two treatments were also compared* 



Rationale 

; , t 

The assumptions underlying the two grading systems were not ex- 
'plored nor were reasons given for or against either 'system. The 
1^ assumptfion was Implicit that readers were familiar with t|^ two 

gradifig systems. % 
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Research Design and Procedure 4 ^ 

Two treatment groups were formed by randpm assignment of all 
o^the 196 chemistry students In pne high school to a pass-fall or 
conventional grading group. Each group contained, four sections 
(classes). T^ere were two teachers, each of whom had two sections 
from each group and taught one pass* fall and one conventional section 
In the morning and one pass ^f all and one conventional group In t1)e 
afternoon. The text used was Chemistry; Experiments and Principles , 
a revision of the original CHEM Study Course. The experiment was 
carried out during one semester of the 1970-71 academic year.. 

Student achievement was measured by two Instruments., the ACS- 
NSTA Cooperative Examination High School Chemistry, Form 1969. Part 
jr_ and Achievement Tests for Chemistry: Experiments and Principles , 
Series I * Four sections of the latter (Chapters 1-3, Chapters 4-6, 
Chapters 7-9, and Semester Exam) were administered* Data from each 
were .analyzed separately* Student scores were divided Into three 
achievement levels (high, middle, and low) on the basis of cisnula**', 
tive grade point averages* A 2 x 3 tfeatment-by-level analysis pC 
variance design was used for each set of scores to test two hypo- 
theses: (a) that there were no differences between mean scores of 
the two treatment groups, and (b) that there were no differences 
between differences In mean scores of the two groups within corre- 
sponding levels (l«e.. Interaction between treatments and levels). 



19 



20 



The Scl\effe test was also performed on pciirs of means vit,hln each 
achievement level « 

Student at.tltud^s were measured by the Sllance and Remmers 
instrument, A Scale for Measuring Attitudes Toward Any gchool Subject . 
Form B was administered as pretest and Form A as posttest* A 2 x 3 
treatment-by- level analysis of variance, with pretest scores a§ co- 
variate^ was used to test two hypotheses: (a) that there were no 
^ dlfferenpes between mean scores of the two trea^ent groups and (b) 
that there were no differences between differences in i^^ean scores 
of the two groups within corresponding levels (i*e«. interaction 
between treatments and levels)* , , , * 

Teaching^ practices and techniques were measured with the Science 
Classroom Activity Checklist ♦ A 2 x 2 treatment-by-teacfter analysis 
of variance 1 was performed to detprmine whetl^er there were (a) dif- 
» ferences in the classroom practices of, the two. teachers, and (b). 
tl^^acher-traatment interaction ♦ * ^ ' ^ ^ . ^ 

. 'Findings ' « - ^ • / , , . 

Achievement: Analysis of the sdores obtained W i:he various 
tests of achievement allowed the rejection of the null hypothesis bf , 
no treatment (main group) effect in four instances* Significant dif- 
ferenced (*03 level) were found between mean scores of the pass^fail 
. grading group and the conventional grading group on the ACS-NSTA 
Cooperative Examination > and on the Chapters 4-6 Test, the Chapters 
7-9 Test, and the Semester Test of Achievement Tests for Chemistry : 
^ , Experiments and Principles * In all f oiir cases , the mean scores of ' 
the conventional grading group were significantly higher than the 
mean sc9res of the pass-fail grading group* ^ ^ \^ * 

• In addition, the null hypothesis of no interaction between treat- 

^ ments and levels was rejected in the case of th^ Semester Test of 

Achievement Tests for Chemistry: Experiments and Principles * The 
Scheff^ test indlgated that on this test, the high achievement level 
of the conventionax grading group had a significantly higher mean 
score than the corresponding level of the pass-fail grading group* ^ 
Differences at ip^her achievement levels were not significant* 

Attitude: Analysis of the data obtained from the administration 
Form B (pretest) and Form A (posttest) of Attitudes Toward Any School 
Subject allowed the rejection of the null hypothesis of no treatment 
(main gr(;[up) effect* Student^ in the conventional grading group had 
a significantly (*03 level) higher adjusted mean score then those 
in the pass-fail group* No interaction was found between treatments 
and levels* 



There tis a typographical error in line 27, page 5* "A 2 x 3 
analysis of variance" should be corrected to read *'A 2 x 2 analy- 
sis of variance"* Also, the statement of the null hypothesis in 
^(the paragraph following does not agree with the hypothesis im- 
plied in a later section* ^ ' 
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Although no interaction was found between treatments and levels, 
except in one case which has been noted, the Scheffe test was per- 
forn^ed on pairs of mean score>^of all achievement tests and th^;a.t- 
titudes^test for each achievement level. In all cases, the ^t^ldents 
in the high- achievement level of the conventional grading grou^'^Jiad 
significantly higher mean scores than the high -achievement level stu- 
dents in the pass-fail grading group. No significant differenced' were 
found on any tests for students in»the middle achievement level. ^ The 
resu^s of the comparison of means for students in the low achieve- 
ment lev^el were not consistent but favored the conventional group. 

Teaching Practices and Techniques: No significant differences 
were found between teaching practice es and techniques used in the 
classes attended by the two groups. No interaction was found between^ 
treatments and teachers. ' 



Interpretations 'ISa 

In cases the mean scores of t^e conventional grading group 
were numerically higher than those of the pass-fall grading group. 
Analysis of variance «howed that these differences wg^ statistically 
significant at the .05 level 6a four achievement test/ and the at- 
titude ^test.. In the only case in which significant: tte a tments -by- 
levels in t,er action was found, the high-achievement levfel of the con- 
ventional group had a ^significantly higher mean score than the ,high- 
achievement level of the pass-fail group. From the results obtained 
from analyses of the data obtained from' a variety of tests, the in- 
vestigator concluded that students in the pass-fail grading group 
showed significantly lower achievement of course oblectives and poorer 
attitudes than students graded on a conventional £i^-point gradjing 
system, i 

The report ends with the opinion that the results of the study 
indicate that pass -fail grading is not a solijtion to grading problems 
, and that students like to be rewarded for high achievement and will 
not achieve as veil if this reward i6 not present* 



. Abstractor's Notes 

First, a question about methodology. The metho4 of collecting 
and handling data on the Science Classroom Activity Checklist Iq, not 
entirely" clear. A score for each student was apparently obtained 
and used in the calculations, since an N of 189 is reported. It 
would, perhaps, have been more valuable if the focus had been on the 
teachers and if measures or indicators of their practices and tech- 
niques had been gathered in each class over a period of time and 
subjected to a different analysis. The data are needed because, al- 
though the .experiment was carefully designed to control for differ- 
e^es between teachers, the effect of teacher bias for or against 
one of the grading systems could have been controlled only if the 
teachers had not known which system was being used in any class. 
Since the teachers apparently did know which system was in use, it 
was necessary^to determine by observation whether their practices 



and techniques varied from class to class* As ^jlported, It Is not 
dear how the Instrument selected for this purpose was use^* 

From the data presented the author seems justified In his con- 
clusion that the conventional grading system produced higher achieve- 
ment scores and more positive attitude toward the subject In the 
sample studied. How much weight to put on the results of tjie Scheffe 
tests Is a more difficult question. SlQce no statistically signifi- 
cant Interactions were found, except In the one case, purists will 
quarrel with the use of the Scheff^. However, the consistency of 
the finding that high-achievement -level students In "the conventional 
grading group had significantly' higher mean scores on all achlevemei^t 
tests and the attitude test, and that the scores of the middle achieve 
ment-lev^l students were not slgaiflcantly different on any of the 
tests Is very persuasive. The probability that such consistent re- 
sults ai;e chance occurrences Is low. This suggests that a study com- 
paring the conventional system to an honors -pass -no- pass system might 
produce useful results. If, as may be conjectured » the high achieve- 
ment-level students need a high grade as a reward but others do as 
well In a pass -fall system, then an honor s -pas s-ncH pass system might 
motivate the high-l^vel students and also eliminate somo of the un- 
favorable aspects of the five-point system. - 

A nuinber of other studies » most of them conducted at the college 
or university level, ^ have shown that students get higher scores on 
achlevelaei;|: tests whto they know that they will receive a course 
grade than when they are taking a course on a pass-fall basis. This 
repeated finding should make us reexamine the reasons for using a 
pads-fall system. Since It seems clear that conventional grading 
produces higher achievement scores, pass-fall grading can only be 
justified. If at all, on some other basis and the outcomes evaluated 
by some other means. 

Another point. worth considering Is the motivating effect which 
grades apparently have, at least for high-level students. Hesults 
of this and other studies make It appear that the desire to receive 
a high grade motivates students to learn the material which they 
will need to know In order to answe^ correctly the questions on the 
achievement tests. Since we know that most of this Is soon forgotten, 
we might profitably ask whether students could be motivated to 
study and learn by some other method which would produce more lasting 
outcomes. 




1. 



/BJ flH9 061 

Herron» J» Dudley, "The Effect of Behavioral Objectives on Student 
Achievement in College Chemistry*" Journal of Reiearch in 
Science teaching . Vol* 8, No* 4:385-391, 1971* 
- Descriptors— •♦Achievement, ^Behavioral Objectives, *Chemistry, 
^College Science, Instruction, ^Objectives 

Expanded Abstract and Analysis Prepared Especially for I*S.E* by 
Vincent N* Lunetta, University of Iowa* ^ 



Purpoge 

Does the achievement of students in a large introductory college 
chemistry course improve vhen they are given lists of course, .objec- 
tives 7 Are there treatment (presentation of objectives) ^ student 
ability interactions? * ' . 

Rationale 

^e author relates the lilvestigation to four priot studies 
evaluating the effects of providing students with inst^ctional ob~* 
jectives* He concludes that the studies have yielded little infor* 
ma£iOQ concerning the value^'of course objectives to student learning* 
The contextual framevorV of the study is^limited t-o the effects of 
, performance objectives on student learning; the authot does not re* 
late the study to more general models or to. a' theoretical structure* 



Research Design and Procedure 

Sixteen conventionally Assembled class sections of approximately 
24 students each were selected for the study from the 650 students' 
enrolled in the freshman chemistry course for science and engineering 
majors at Purdue University* *pach of the *XS sections in the study 
was assigned as an experinenfai or as a control group* The treatment , 
consisted of handing out six lists, containing a total of 131 perform- 
ance objectives, to students in the experimental group during weeks 
2, 3, 5, 7, 9 and 12 of the 16 week term. (The objectives were pre- 
ps red by the investigator on the basis of course outline, assignments, 
past examinations, and the test; **no effort was made to make the 
examinations correspond exactly to the objectives lists, but *** 
substantial overlap did exist*'* Fifteen sample performance objectives 
are included in an appendix to the paper*) 

The criterion tests were three regularly scheduJ^ed hour examina- 
tions prepared by the course lefcturer* The paper does not provide 
information defining the weeks in which the exams were administered* 
Student SAT scores were used to divide the sample into three ability 
levels of approximately equal size* Analyses of covarlance were run 
to determine if there were differences in mean scores for each of 
the ability subgroups on each of the three examinations* Analyses 
were also run to determine if there were ^dlf ferences in mean scores 
for the total experimental and contrbl groups* Similar analyses ^^re * 
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reported using "diagnostic" pretest scores as the covarlate and as 
the basis for separating students into ability subgroups in place of 
the SAT data. The diagnostic test was adsdnistered at the beginning 
of th^ sesttster. In the data analyses the individual student was 
used as the experlnental unit rather than class groups* 



Findings . 

Kuder-Richardson 20 estiinates Df reliability for the thtee exams 
ranged from .68 "* .72. 

Analyses of covariance did not show significant differences in 
means for the first and thir4 examinations. A significant difference 
favoring the experimental group at the .Q5 level was found for the 
second exam. Adjusted test means on this second exam using SAT scores 
as the covariate shoved a difference in means for the lower third of 
the class favoring the experimental ^roup at the .05 level. A dif- 
ference in means favoring the experimental group at the .01. level 
was found for the ^4)per third of the dasa^on the second exam. For 
the middle ability group the null hypothesis was not rejected. 

Using the pretest scores as covariate and as the basis for 
separating the class ^to ability subgroups / significant difference 
(.05) favoring the experimental group again appeared only on the 
second examination* In this analysis, only the top ttiifd of the 
class showed a significant, difference in means favoring the experi- 
mental grou^ (.05). 



Isam 2 suggest that. ^n, a lafg/a course in which 
dj^ficulty in under sutnding exactly what is ex- 



Interpretationa 

'*The data for 
students may have di 

pected of them, the simple ptocedure o.f providing s list of behavioral 
objectives will help them learn ,thc. required material*- %t is not 
clear that the procedure Is more valuable for me ability group over 
another ... no consistent treatment -^ability inter4ctions were found." 
The investigator offers the following reasons «hy dif ferenc«i were 
found only in the second of the thre^ examlnatxona: 

(1) The quality of objectives was' not undLfom. Objectives 
for Exam 3 were particularly cWkward. ^ 

(2) Exam 1 is essenti a 'review of concepts that are 

, normally taught in a high school chemistry course and 
all students in thib study had coii^leted high school . 
chemistry. For thisy&xam the lists of objectives 
added little inforftiation. 

The investigator suggests that yia observed differences may have 
been the result of more meaningful preparation by graduate instructors 
in charge of the exparimental groups since the objectives were avail- 
able to them rather than the result of more meaningjEul study by th^ 
students in the ^Ciq^rimental groups. 



Abstractor's Kotea 



Thlw research study Investigates an issue of contemporary cqn- 
cem and interest in education. One may question whether the author 
has related the study and the paper sufficiently to other relevant 
investigations outside the area of science education. One may also 
question why tha stu^y was limited to an investigation of cognitive 
variables. What effects did the objectives have oA learner attitude 
and interest? 

The' most serious question that must be raised is whether tl^e 
study clarifies the questions the author has set dut to investigate. 
Certainly » the in^lications that can be drawn from the study are con- 
siderably narrower than the title (}£ the article would isiply* The 
significant differences favoring the experimental g^roup that were 
observed in one out of three exams can hardly be generalized to a 
broader population in spite^ of the reasonably large santj^ie size. 
What is the detailed evidence and rationale that enables the investi- 
gator to discriminate between the results of Exams 1, 2, and 37 The 
^ decision to use the individual as the experimental unit can also be 
questioned, in spite of the fact that a rationale for that decis'lpn 
is discussed in the paper. 

The paper reports data and findings more carefi^ly than do maxsy 
j:onteBq>orary paper* reporting research study* In^fSttt the author 
is to be cocnended for his candid tfid explicit comments regarding 
t^e areas of weakness in the investigation. He lias pointed to many 
of thjB limitations, in the study that are outlined below. The follow- 
ing (actoreii, could well, have masked the eff ectd of the, variables the 
iavestigator intended to extioiUe. ^ ^ 

* 

,j (1) The questionable assumption* that no differences existed in 
th^ teaching abilities 9f the graduate instructors and th^ methods 
bf assignvent of. students €o those ^instructors . , 

(2) The failure to reference exam items to specific objectives 
givep to the students. (At lea** an i|ifter-the-f^act review might 
hav^. been conducted and selected .iteids eliminated from .the examina- 
tion^ ojn that basis. A &ore optimum ap);>raac]i Vould have been to use 
the performance objectives a^ criteria' for creating the examinations.) 

• ,) ^ 

^) The effects of the lists of objectives on the instructors 
of tha .experimental groups.' (The investigator should have given the 
objectives to all of the ina true tors or to none of the instructors ** 
in bot^ the experimental^'and control groups', since he was trying to \ 
assess U\e direct effects of objectives on student achievement.) 

(4) , The lack of cjcp,licit informjjtion ^provided students regard- 
A*' ing the'nature of the lists of objectives. 

(5) ^ The lack of control over access to the lists of ol>jectives. 
(Student^ id the control group may well have received the lists from 
friends in the experimental group.) 



(6) The quantity of implicit Snd explicit information cpncern- 
idg the structure goals of .the ^ccrd^se^ available &o the studt^ts 
through media other than the I'fsts of ^lijectlves . ^ 'V 

^Although the Author 'refers ,to this investigation as a "pilot 
study," he does not elaborate upon ''the iaplicationV^ if the study^ 
for future researtih. Be alscr does not discuss the implications of 
the limited findings^ fqr course design ol:, instruction. 
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Huff » Phyllla and Marlla La^guio, '^Thse Effects 'of thet Use of Activities 
of SABA on the Oral Conmtk^ioation Ski}.ls o5 J)isa(^anta^ed KindexT^* 
garten Children*" Journal of Research in Science T^a'6hing , • 
Vol/lO, No. 2:165-J73, ,197a; ' <^ , • 
^Descriptors— tCoiaimiiication Skills, ^Disadvantaged Yputh> 
, • Educa£i6fial Research, *Kindetgartcn* Children, Language bevefop- 
uenty ^Language SKllls, ^edia Selection, ^olenc^ Education,.^ 
Socioecdnbmic Status * * , ^ ' ' ' . * * ' 

Expanded Abstract anU Analysis Prepared Especially lEpr I.'S*.Ev by . • 
David P. Butts, University of^Gfeofgia. • • ^ 

• To invetttigate the^6ffects of part^.ctp^tibn in the activities of 
Science - A Procasg Xppti^ch (S^APA) otv the'ofal cojnmunlc^tix)n sltills 
bf di^Mvantaged l^de;rgarten children* . • <^ 4 • » • T .* 



Rationale ^ ' . ' - 

Science activities requirer the use of compiui^bcatioa skills to "* 
allow the> child to exchlmge ideas , identify problems, and Interpret 
eycnta,. Thus i't is logical to expect that children who lack communi-. 
^cation skills, can jLm^rove these skills by participating^ in\ science.,... 
activities. ' * 

; , • • i ' * 

Severai.stuHies have been conducted, to test this hypothesis by. 
applying tHfe program Science - A Process Approach >^ ^pm ^and^ Stexnxoler 
f oun4 that with. SpanisS^^speajang'^HTsF'p^]^^ 

concrete manipulation activities .gave tfh*«e children ^ f p^dation ^ *\ 
for successful learning. Ayexs and Mi^s^^ fouxld that lan^vage pkills 
related tt reading readiness ^of kixrdei^garten children increased with 
completion of Part A o*f Science A Procttsa Approach * 



Research Pes f pi and ProcedUfe ' / * \ 

The subjects used in this study we^c* 113 kinderaar'lea , children 
in an lnner--clty school* The subjects were etitpilcd in four dass^t 
two' morning and two aftemooiv* The experimental gruifp consiste^d of 
a randomly^ ch6t en morning (E^) and afternoon clitss (E^) * Vxt othet, 
^tHo daaseft one morning (Ci) and one" af temocgi ^^62) . - were the 
control* grou^* The. control group, was made up of 48 students, 24 
fema^ea and 24 males* The experimental tx^atment group, consisted 
of '52 a'tudents, '23 females and 2S males. . " 

^ All*8ubjetts were given a pretest — the Test of Orax Commuui- 
cirtion Skills (TOCS)» Tfiis test measures silc oral tranoml^tting 
jCspeaking) sk^ltf ^^hix:h include: 

1) language output and expressiveness 
, • 2) '*ypcabulAry - . > 



3) genital 'mcif^g tixd ixlead . • ; 

4) .aentence s£,n;|cture , 

. 5)*" .defining wo^<Jfl ^ 
6) t^erage. length of. sentences 

The TbCS\al80 yielda t^o oral receiving (listening) scores Including; " 

[ , , 1) . listening bch«viot < . 
f ^V'" lis tenlil^- comprehension . 

The, treati^ent; consisted of "22 lesbons, a through k, in the activ- 
ities of Part A, Science - XlfeacLess Approach for the experimental 
groups. The coiltrol groxxps vere,preB<Bnt.lid vith.22 lessons from 
Springboards to Science * The invest i||Wtoy. taught all lessons to all 
groups.. The lessons vere; presented in half -hour periods, two days , 
per.' week for ^2 weeks, Th^ lessons from Springboards to Sciyce 
were taught by dfbonstration r presentation, approach and quecttions 
aslced by the teaser. The teaching *pproacH for Science - A Process 
Approach was guided by an inqUiry-discover;^ technique. The children 
Vcore given the material^, and were free to explore and discuss their 
observations, . V. - • 

At the end of the trea'tr^ent , .100 of the original 113 subjects 
were given the' TOCS as. a posttest.** W ' - ■ 



Findings " ' - •* 

" : • . ' ■ 

Using the one-rvay analysis of v*tiance, the'^CS pretest scores 
were analyzed and the^e were no si^fnificant differences among tl^e 
four groups. ^^-.^ 

. Relative to hypothesis 6ne> it.^iu found that the experimental 
subjects Of 'this study perfonfi^d significantly better than the. con- 
trol 'Subjects in total transmitting skills and on the* oral trans- 
mitting subskills of language dutput and exptessivei^ess, vocabulary, , 
general meaning and idjias, and sentence structure^ Thus disad-, 
vantage d students who participate in Science - A Process 'Approach 
do give more truistnitting in communication skills than siMlar students 
who participate in a diffeteijt 8\:ience curriculum. 




Interpretat'ioo ^ 

From. this study, it can be concluSM* that oral cominication 
skills are clearly enhanced when SAPA curriculum is presented to dis- 
advantaged kindergarten children, • 



Abstractor's Notlas^ 

< • 

This study provides meaningful fresh insi ghts i nto a continuing 
search ^or betted ways to assist children wij:h >U^rning problems. 
Vniile the result's are useful, the rationale of ihe study Could 1}e 
substantially strengthened if the authprs had shared with the reader 
the reasons or the logic of expecting one science cun^iculum to have 
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been useful in* influencing the communication skills of five-year 
olds* Further, it could be. questioned ^as to why science was selected 
as a subject^ rather than miisic, dramatic motion or mathematics? 

As the description of the procedure is studied, the reader is 
told that the Investigator taught the sdi^nce curriculums to the 
experimental and control groups* The outcome o^ this contrast in 
school experiences is significantly different* The reader is left 
with the inference that it is due to the curriculum variable. But 
left to one's imagination is if this is due to specific differences 
in either substance or child ten- teacher interaction between the 
treatments* .Or might the contrasting results be due to children's 
Interest in the science topics — unless the topics in each program 
were the same. Unspecified by the authors are the variables which 
were contrasted in the treatment. • ^ 

In reflec^tlng on the findings of this study, one should be 
able to now reexamine the linkages between variables and speculate 
on probable causes* In this study what do tjie findings now tell us 
abou^ li&a communicating skills and science instruction are related? 
Thalt they appear to be related is evident* Thtit this relationship 
is ,due to a specific currlctfluin, Science - A Process Approach , or 
the content of the science instruction, or the teacher, or the 
students, or the instructional materials, or the teaching strategies, 
or the tim6 of day or other variables is not considered by the authors* 

Finally, the authors of this study are the best qualified in- 
dividuals to specify the implication of their study for instructional 
programs for young children* While briefly alluding to tills .respon- 
sibility tjhrough a "perhaps" statement, the report of their study 
could be strengthened by thorough discussion of what the findings 
of their 'atudy have to say to the teacher of young children* 
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Hunter, Walter E., "Individualized Approaches to Chemistry vs* Group'* 
Lecture Dl^.cussions , " Journal of College Sclptace Teaching , . 
Vol. 2, No. 4:35-38, April, 1973. 

Descriptors: *College Science, *Chemistry, Evaluation, Educar 
tional Research, *Group Discussion, Instruction, ^Individualized 
Instruction, Science Education, ^Science Activities 

Expanded Abstract and Analysis Prepared Especially for. I.^.E^ by 
Glen S. Aikenhead, University of Saskatchewan. 



Purpose 

I 

The following questions were posed: ' ^ ' 

(1) How does the individualized learning apptoach compete with a 
group lecture approach with respect to general chemistry 
achievement? » , 

(2) What effect does a pretest on unit objectives have on 
achievement? 

(3) What effect do learning theory lectures have on achievement? 

(4) What effect does criterion evaluation of the unit test have 
on achievement? ^ 

These led .to the following null hypotheses: 

(1) there are no significant achievement differences between 
students in the different treatment groups, as measured by 
the unit test scores. 

i 

(2) there are no significant achievement differences betweeti 
students in the different treatment groups » as measured ^y 
the final test score. ' 

(3) there are no sigiflf leant interaction effects* between dif- 
ferential treatments and tha pre-existing condltlono^ of 
high and low SCAT scores, as measured by student achievement 
on unit or final tests. « 

«.(4) there are'no significant interaction effects between dif- 
ferential treatments and pve-existing conditions of high and 
,loy high jBchool rank, as iQaasured hy student achievement on 
unit or final tests. 

Rationale* ^ . ' , 

No rationale was stated. No theoretical models » no previous 
research, and no under lyii;tg assumptions v^re mcsntioned.^ f 



O .30 



ERIC 



36. 



Research Design & Procedure 

Sample': There were five groups, each with 24 subjects randomly 
selected from ^14 students registered in a general chemistry course 
at Heramec Community College^. 

Design: A randomized, post test only, experimental design was 
used, not only .to compare "Individualized learning" vs. "lecture" 
groups but also to s^tudy three variations of the Individujali^ed learn- 
ing treatpient. Treatments lasted for one semester ^d were as follows: 

Group 1 ("individualized learning") individualized materials** 
(readings, audio tapes, experiments, demonstrations, films, work 
sheets, lab reports, ^iminars, and problems). 

Group Z ("pretest") — identical %q #1, plus a pretest before 
^ach of 11 units » 

Group 3 ("learning theory") — identical to #1, plus four lectures 
throu^out the 'Semester on how to learn chemistry. • 

Group, 4. ("cTiteiAon' unit test^') — identical to #1, plus an 
. insistajcice upon at least 90 percent achievement on end of unit 
tests. • ' ^ ' ' 

Group 5 <"lecturfeL*) — similar to #1, except the individualized 
learning activjLties were replaced by two lectures covering the 
' same concep^t's- 

Blocking: Ei^ih »group of 24 subjects were blocked in two dif~ 
ferent ways for tUo Separate analysis :, high/lpw SCAT and high/low high 
school rank.' " . " - i > ' 

''' ' . ' 

Dependent varictbles : Unit tests and a final examination were used, 
both purporting to '^assess chemistry achievement (n9 reliability and ^ 
validity data were 'reported)'. ' , 

< » * % ' 

Analysis: AHOVA was used, once for eac^ 'type of blotking and for 
each dependent variable, followed by Tukeyi gap te^ts. * 











Findings 










Sumiarr of SiKnIf leant FindixiKd 




Measure 


Analysis 


Source of Variation 


Significance 


UNIT TESTS 


ANOVA 


SCAT . - 

H>S* rank. 

Treahnent 

Treatment x SCAT 

Treatment x H.S. rank*'^ 


' .001 , 
- ..025 
.001 ' 

\ooi 

.001 




Tukey 


Groups ^2 & 5' . . 

A & 5 . \ 


.01 
.01 


FINAL TEST 
> 


ANOVA 


SCAT 

H • S • rank 

Treatments * 


' .001 
.001 
•001 




Tukey 


Groups 1 & 5 

2 & 5 

3 & 5 

4 & 5 


.05 

• 01 

• 01 (sic)* 
.01 


.05 level of probability 


It should be 0.1 • 


• 



In other words, the findings reported were; 

(1) "True achievementrWtterenceb," as measured by final atod 
unit test scores, "exist between experimental treatmetit 
groups*" 



(2) 



(3) 



(4) 



"True achievement differences, -as measured Ify fitlal test 
scores, exist betweeb groups receiving an indlvidualize'd 
* learning activities treatment' and groups receiviiig a lecture 
•treatment." 

* • * 
"Significant achievement increases, as measured by Jflnal 
t^t scores, may be expected as a result of pretesting on 
,uitit objectives plus individualized learning activitiiis." 

"Incremental achievement differences, \8 measured by final 
test scofesi'^ist as a result of critetion evaluation of 
unit tests ^" 



(5) 



"Learning theory lectures do not produce incrementaX.jichieve- 
ment differences, as measured by the final test scores 
unit scores.** 

(6) "Significant interaction exists between treatment and 

scholastic ability" ... and between treatment and prior 
* academic achievement, as measured by unit test scores." 
(The interaction was not described.) 
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Interpretations 

"This research confirms the hypothesis that test achievement In 
general college chemistry Is directly related to the Intimacy of 
student participation In the learning process , , , Research results 
clearly Indicate that students In the Individualized learning pretest * 
treatment group achieved at a higher level on the final test than ^he 
other treatment grpups. The researcher concludes that practitioners 
can expect positive Incremental differences. In final test achievement, 
when pretest^ig Is used.... I conclude that the externally Imposed 
requirements of unit test achievement are directly related to Increased 
unit test achievement. 

This research supports the utilization of an Individualized approach 
to general college chemistry." ' • 



Abstractor's Notes , 

The omission of a rationale means that: (1) t^iere Is no theoretical 
framework from which rational hypotheses may be foi^lated, and (2) 
there Is no review of similar studies In the literature which might 
have given a rational context for the present investigation. ^ (A review 
of the literature may have mentioned studies by Grobe (2) and Vander Wal 
(7) » both of whom' essentially found null Xesults on a gre^ater variety 
of dependent variables.) Anderson's (1) plea for rationally based \ 
research could be reread to advantage by all researchers. 

One basic quality of research is its ability to be replicated. 
The present study does not appear to be replicable because the descrip- 
tion of tl?e independent variables is not In operational terms. ,For 
example, what was the role of the professor? What does "lecture" really 
mean, in operational terms? A plethora of curriculum X vs. curriculum 
Y type of studies during the 1960*s has not' yielded reasonably unam- 
biguous results for this very reason [Robinson, (6)]. One of the most 
useful methods of operationlizing independent variables is the use of 
a check list. ' Kochendorf er (3) demonstrated the feasibility of this 
technique. Several researchers have followed his example; for 
example, HacBonajrd (4). 

The randomized, posttest only, experimental design (Campbell and 
Stanley's #6} is a paradigm most researchers strive to adopt. The 
ptesent investigation is an exemplar in its application ^f such a 
research design. While the ANOVA should give reasonably good results, > 
the more powerful analysis of Vovariance is traditionally favored as 
the appropriate statistic of analysis. It is also customary pfactice 
to describe the significant interactions when one discovers them. 

The instrumentatidVi is fundamei^al to any jinvestigation. Unfor- 
tunately, pertinent Information concerning the dependent variables is 
missing in the present investigation. It is essential for" a researcher 
to report test validity and reliability data. ' 

The researcher always walks a difficult lin^ between oyergener- 
allzing his conclusions and not generalizing enough from his specific 
set of results [Raths, i5)\f* However, his logic connecting his 
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results with his condiis^s must be tight. The reader may wish to 
reexamine the results and the concltisions of the present study. Only 
conclusions #3, 5 and 6 are actually supported by the results in the 
summary table. The Tukey gap test revealed no significant differences 
aiQong the first four experimental groups., unless a case is made sup- 
porting acceptance of 0.1 level of probability. In aildition, an 
argument is required to logically connect * individualized learning" 
with "intimacy of student participation in the learning process." 

A research study glared toward articulating knowledge in a partic- 
ular area will have different criteria associated with its generali- 
zations than a rtesearch study aimed at evaluating a learning experience. 
In the latter case, not only is statistical significance a concern, but 
the common sense significance should also be discussed in order to give 
"a^otential program adopter a possible basis for making a decision. 
That»i^, is it worth. all the trouble of changing to an "individualized" 
.program when one might expect the reported improvement in student 
achievement? In the present study, the "lecture" group is about a 
standard deviation below the "pretest" individualized group. Most 
researchers, would likely agree ^hat this observed difference likely 
represents a sizeable or worthwhile increment in achievement* sizeable 
enough to warrant the adoption of "pretest individualijsed learning" 
(assuming one could replicate the program). This issue could have been 
discussed by the author, thereby supporting his final interpretation 
that his "research supports the utilization of an individualized 
approach to get^eral college chemistry." 
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Purpose . . * > 

In this study an at€em^t was maac. to examine the cognitive be- 
havior knMi as categorizing among blgh and loy socio-economic 
status (sis) children* and to Identify strategies used by theae 
children as they were observed in the process of categorizing. 

The ability tp categorlze^^was described as an Inclusive pro- 
cess which combines observing. (recognition of attributes) , comparison 
for differences (discrimination) , and comparison for similarities 
(equivalency) . The specific stage of categorization examined was 
that characterized by consistent, exhaustive, dlchotocaous grouping |^ 



Rationale • 

Along with other mental opterationv, the ability to categorize 
has recently been accorded considerable attention due to the shift 
.In is^ortance from verbalized knowledge about science toward an 
emphasis on the cognitive processes associated with science. Gagne's 
model vhlc^ describes the basic cognitive processes of science 
(observing ibd organizing envlron;mental stimuli) served as the 
theoretical framework for this investigation. References to Xnhelder 
and Plaget (19^4) And Vygotsky (1962) allude to the developmental 
\ nature of. this Important cognitive behavior. ^ 
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Research Design and Procedure 

The population consisted of 60* kindergarten pupils randomly/ 
selected in equal numbers from four high SES classes and four lew 
SES classes in the Oakland |Unlf led* School District of Oakland, I 
California; chi square tables were used to determine the appropriate 
•as^la size tcr meet a desired explained variance level of at least 
25 parcent> Children were tested in small groups of four and five. 

?our tests from the Lawrence towery Visual Resemblance Sorting 
Tests yJkr^ administered to assess pupils* ability to categorize. « 
Pupils werft- asked to categorize pictures according to shape, size 
and pattern using attributes singly, in paired combinations or in 
a triad: Test I "required finding a picture that resembled an exemplar 
from a reservoir of pictures; Test II required findings two pictures 
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that resembled each other within a reaer^lr (tio exemplar); Test III 
required, finding a picture that had ng duplicate among a reservoir 
of scattered but matched pairs; Test IV required finding three pic- 
tures that were alike within a reservoir (no exemplar) . 

Individual interviews wei^e conducted with a small group of the 
original sample for the purpose of studying Strategies. Pupils were 
asked to discuss their solutions to the test^^ dnd to repl/cate the 
tests using ^manipulative j>lock8. ^ 

Eye movements of pupils performing written tests and finger 
movements of pupils during interviews were' also ej^^cted to provide 
the investigator with information about categorizing strategies used 
•by pupils. , 

Analysis of Variance (Newman*-Kuels Post Hoc procedures) was 
carried out on written test results to determine differences in per- 
formanoe between (1) high and low SKS groups, (2) Tests I, II, III, 
anfl IV,.and (3^ test Items varying in difficulty. 

Fjjadings * ^ • . . ; 

Profiles of test scores between ^ES groups we^'e strikingly 
similar. Yet, results supported the liypothesis that high SBS pupils 
were more able categordLzers than low SBS pupils. Differences between 
overall means for the two groups were significant (P « 21.55, Alpha - 
.05). The performance of high SES pupits was consist^tly superior 
on all. tests: however, the difference between groups was not signifi- 
cant on Test|%III. 

Comparisons of performance on different tests revealed that 
kindergarten children can find duplicate pictures in a reservoir of 
pictures when an exeiiq>lar is givea (Test I) more easily than they 
can find two or three identical pictures in a reservoir when no 
exemplar is given (Tests II and IV) and more easily than they can 
exclude a picture whic^lias no matched pair Within a reservoir (Test 
III). Performance oi^^est I was significant^ better (Alpha « .01) 
than performance on^^l other tests. S 

Pupils were found to categorize best when* test items involved 
the attribute.* shape. Percentage means were tised to report test 
item difficulty; in descending *order of difficulty, the test items 
were solved correctly'by the following percents of pupils from the 
combined groups: shape - 91.7 percent, shape/size - 70,4 percent, 
sha^e/pattem - 65 percent, shspe/size/pattem - 55 percent, size/ 
pattern 52.9 percent, size - 46.7 percent, and pattern - 35.4 per- 
ifent. Differences between test items were reported to be signlfi- 
/cant (F • 51.26, Alpha - .05), 

Descriptive data on strategies were limited, the author pointed 
out, due to the techniques used. In general, eye movements appeared 
to indicate the random choice of a picture from the reservoir and a 
one-by-one comparison of the picture with other pictures in the 
reservoir. When an appropriateTtotch was not foxmd, a new picture 
was selected and the pitocess was/repeated. This strategy was least 
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effective when pupils were lisked to find three Identical pictures. 
After xaarking the first tvp^plcturefs, pupils appeared to switch 
attributes and nark a third picture which shared soioe atttibute with 
the second but not the first marked picture. ' ^ 

Interpretatfotts 

The superior per'fornance pf high SES pupils 'qn categorizing . ^ 
tests is interpreted as evidence that '^SES difference is deeper than 
Just'*baslc skills* in riea4ingt language arts and other school tasks. *^ 
The cluster of variables constituting SES, the investigator argues, 
* "seems to powerfully itif luence development of mental K)peratlotia re-^ 
quired to master basic skills." / 

In view of his findings, the investigator recommends practice 
or guided experience where needed to enhance the developmept of this 
cognitive behavior. alludes to a possible io^licatlon for ele*^^ 
mentary school sciep.ce programs^ and pretesting of cognitive abilities. 
Finally, he suggests the need for a study "ained at multiple cate** ^ 
gorizing situations and strategies over several years o^ development.." 

^ ^ ' • « 

* Abstractor's Sotes 

' ] r* ; 

Hr. Johnson has conducted a3^ investigation which i« Of interest 
to us as science educators hecau^e it advances otir knowledge ^about 
one aspect of the cognitive process known as categorizing, 41s it has 
been observed among high and loW SES kindergarten pupils* 

> * ^ i 

The paper is easy to read* It is deaxly anch^ed to a sound 
thi^recical base (CagaS, Xnhelder and Plaget, and V^gotsky). The 
statistical analyses Ire appropriate ^to the research design. And, 
the findings are presented in a reasonable and logical manner. In 
terms o^ these aspects, Hr. Johnson's research might ^erve as a com- 
mendable model for others. 

I'yo^d like to pose some questions now which might be regarded 
as '^mlnor but woifth mentioning" in the interest of beginning re- 
searchers* 

Vhat is the hypothesis? The purpose of this investigation Is 
expressed clearly And succinctly; to examine categorizing perfprmance 
and strategies. However, Hr. Johnson has kept his hypothesis that 
high SES pupils are laore able categorizers '"hid den .under his Intro- 
ductory vest," and reveals it as an hypothesis only after he futnlshes 
the evidence to sup{>6rt it in the Results * This is not a serious 
matter, but many readers prefer to have the author's expectations 
made explicit from the start. Though few would expept hypotheses 
to be. numbered, lettered, or Indented in research publications, most 
readers expect consistency. When initial references to hypotheses , 
occur midway through an article, some rea4ers pause and wonder what 
else they may have missed up to that iK>int* * 

I 
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WKat^ls the background of the subiects? The function of thlA 
investigation was to survey. Ihe status of a particular variable, & . 
proceas calle4 categorizing, among tmo geo^raphjLcally'seplixated pop- 
ulations. In cases vhere the varia!^le being asftes^ed is not intro- 
duced by the inveatigator but is prestuned'^o have ^developed through 
o^er influences (to this 6a8e, aoziH and econo^c) » readers look 
to the investigator to summarize all available 'relevant inf ormatioti 
. on the comparability of the tVo populations s^inpled. 

Although Mr. Johnson notes that kindergartener were sampled 
**to minimize the 'influence of eo^^ded school experience^*' ^ac^ground 
on the previous Experience of theNsubjects«is l,ijbiited.' Jt vo.ul4 be 
helpful to know (a) how «arly in the" schtiol year, the resear(:l\ wA 
, conducted, since 'instruction in: categorization, is part pf the kinder ~ 
garteiv curriculum In many schoolp, and'jCb) wh^the'r pupi},s in any pf*. ^ 
the eight classes sampled had received formal training priror to . • 
kindergarten, since man^ high S£S pupils attedd nursery schools and. 
since some low SES pupils in the Oakland Unified 3<i^ooX Dfstrict re- 
ceive enriched experiences through' programs 9uc^ ^ Head S£art and 
funding desi^ated by legislative action^. ^\ ^ . ^ 

' * . * • * ^ ' . . '• - 

Vhat about the test and interr^lew? A nymbA of t^dtjs ire afvail- 
^able which jaay assess pupils ' .ability^ to categorize. Any normative . 
. data or information on the reliability of the Lawrence Lowery Vjf^al 
Res eid> lance. Soxt.ing Xesta would have been useful toz readers Inter- 
ested in comparing Mr. Johnson's findings with other research . ^ 

The descriptive da'ia on the "£o\law^up Ihterview^" are* ^xtrcftuaiy 
.interesting bScause they hold the p6tei\tiai for ptpviding*-4mport«nt 
^ clues about similarities or differences in strategies used by high ^ 
,.and low S'BS pupils.' However, t'he ^ascription of th^ procedure fol- 
4ldwed during the follow-up interview:^ is spmewhat skor^^hy* It would 
be interestingv to kt\a%t (a) the number pi pupils.. interviis^ed, ,(b) the. 
approximate duVation of the interviews, and (c) perhaps evi^ the^^e- 
lationship of performance on tite manipulative blocks test to per- ^ 
formance on the written tdstv* , . • . 

How are thft results related to the'ttieorfitical model7 In this 
inve8tigation> if one assumes with Inhel^r and Piaget (1964) that 
the ability to categorize is developmental or* "begins at birth," , * 
according to Mr* Johnson, then he becomes curious about how the find- . 
ings described here^specif ically, on differences in difficulty 
between tests and test items'— relate to various notions about the 
development of the categorizing process. The theoretical connection 
is possible to make, of course, but it is not too obvious in the 
author's Rationale or Interpretation . 

Some final descriptive reference which explores hew the above- 
mentioned results might be related to specific aspects of Piaget *s 
developmental t&odel, of Gagnt*s model on the hierarchical nature of 
cognitive processes in science, or of the work done by Lowery and 
Allen (1969) would be quite valuable. Mr. Johnson makes this kind 
of theoretical connection very effectively with fi. brief reference to 
Deutsch and Brown (1963) and SES. 
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Lfhn. Marcia C. and Ut^ V. Peterson, "The Effact of Direct Experi- 
ence-with Objects od Middle Class, Culturally Diverse and 
Visually J[;nipalred Young Children/' Joutnal of Research in 

Science Tea'chln|^. Vol. 10, No. 1:83-90, 1973. 

Descriptors-ri^lity, *C1^8ificiition, *Educational Research/ 
'^Eleiaentarjr. School Science, *Instruction, Science Course 
. . iBtprove^ent Project, *Science Education^ Student Ability 

Expanded Abstract and Analysis, Prepared Especially for LS E "by 
^ Delmar Janke, Texaa- A & M University. 

Pu^ose ' ^ • 

The puifpos^ 0/ the study yas to investigate Piaget^s theory of 
equilibration by comparing the effect of direct experience with ob- 
jects on th'e logical i;easoniBg ability of middle class CMC) cul- 
turally diverge (CD), and visually impaired '(VI) children. 

U oae e^eriment^a Piagefcian task was used to compare the 

^^?^''i*^^!J!J^nv^^^'^i^ ^' *""P« °f children studying 

SCIS Materi^g Objects with. those who had not studied the unit. 

Another experiment measured If: and VI students' ability to name 
properties and material*^ and to sort objects. i ^ 

Mtionale « ^ ' ' ' 

The investigators identified aeveral earlier studies which com- 
pared the logical reasoning ability of Children from different en- 
viro^aaocft* , ' ^ ' . ' 

"Bovet (1) and Bruner (2) studied childrto without school ex- 
pcrience and found* they learn conservation pf substancfe and liquid 
m9re slowly than do children who attend Bcfiool/ Culturally dia- ^ 
advantaged chi'ldren progress a^ a slower rate on classification than- 
do middle class children (3), ^4), Hayes (5) and Newlarid (6) have 
shown- that visually impaired d\ildren perform mord poorly than 
sifted children on tests of InneUigiince. Piaget (7) reports that 
'blind chflflren, tec&Cae the^r lick visual experience with objects, * 
develop^ logical abilities more .slowly than/sighted children* Classi- 
fication-tasks have bden used in many o^ Hiaget'd (8)., (9) studies 
of logical reasoning. Several recent elamentary school curricula 
- include units to give children experience in classification (10), 
• C*l) > (12).** 5. ^ < * 

»^ ■ ' ' ■ 

^ Research JDesign and l^rocedure 

A^ Firat^ Experiment • " f , 

^ The first iixperiment inv63,ved 197 first grade students — ' 

four CD classes,, five MC classes and one VI ^lass. Thfc experiments 
group consiiited of seven classes (four HC, two CD, and one VI) where 



SCJS Material' Objects had been taught. The control group consisted 
of <ine HQ' and hfo CD classes . The VI class serve^ as its own control 
due to thte small number of subjects (N ■ 15>.^ " ' * 

*' * . ' , • ^ - " * . ' ' . ' . 

Thcf Investigator, discussed with each ^lass whjit . l^t ae^t to * * 
flpa^ and ^at It meant to sink,' Then each studez^i was given ten^' 
objecta oil, a tray and asked to sort the objects Intd two piles ' 
those wfilch' he thougjit would float and those which ha th6ught WoiAd 
islnk. The studenf was then asked to test his predlcMons. 

' Following this the investigator individually ^interviewed each 
stud^t using ^ix questions adapted fron^ Inhelder and Plaget. Finally, 
-each Q^deirt t(afl assigned to one of three stages of development simi- 
lar ^ta the stages described in Inhelder and Plaget (3)« * * 

B. Second Experiment . ' , ' -\ 

The Second experiment involved 30 first grade students . . 
15 KC studeatB and the same 15 .VI students whd were tested in exr 
periment one. In this experiment |dl students served as their own 
coptrols'^ ' * • . ' t» • 

The investigators devised a test of ability' to (1) name the 
classes that an object belongs in tl-e.y to name the materials 
and properties of 9bjects)> apd (2) sort objects. Each child 4fas . . 
given eigjit objects and asked two questions of each object* He was 
first asked, "Here is the first (etc.), object. Can you 'describe' 
, this object?" A^^er he had answered that question he was asked, - 
**What *is;e can^ou tell me about Ijt?" The objects were^ then placed 
in a tr«y and 'the students -did.^ sorting excrclseV ^ ' ' 

The investigator^ listed and Tfjfitcgorized «ll of ^he descriptors 
in the first part of the experiment into t^ree categories; properties', 
preJ>roperties, and others. Fo^ the skirting task, the ^estigators 
categorized t^e students* reasons for forming the gtoups according 
to the stages described by Inhelde&'and Plaget ,(9) '. '■■ ' 

FindinRs' • - ' 

A. First .Ejtperiment-r v 

the *investigat;lon re\;ealed .th4t expetiex\tally^ disadvantage^ 
first graders (both CD and VI)^ who^ b^d atudled Matarial Objects 
scored 'significantly higher on t^e floa'tlttg and sinking exercise than 
did their control's* The ^ students scored very high on the exer- 
^cisft i^ethet Ot tiot they hdd studied Material Objects . 

J- " . - ' ' 

Scores for tl)e VI and CD students who had studied Material 
Objects did not dlff^t significantly from each other on the pre or 
post - testa. ..^However^ on both the^pre and pbst - tests they dlf* 
fered from tire MC stude^ti?. . . . . * 

B . Secon(^ 'Bxperifbent * 

. In the \^aminj the classes" portion of the experiment both 
the MC and the ^ sttjidonts .used significantly^ mora properties ^on 
the poattest than on the pretest. The VI students also used signlfi* 
caxUiXy m6re preproperties and total descriptors on tKe post test than 
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on the ptet/sat* The VI students used significantly fewer properties 
and l^repropertles than the MC students *on the pretest yahile on the 
postteet there were no, significant differences. 

.Results from the sorting exercise revealed that the study of 
Material Objects laproved the performance of both the>lIC and ,VI 
.students. There were no significant differences betweeb^the two 
^groups on aither the pretest or the post test. 

* * . 

♦ . " . 

. - ' 'Interpretations ^ . - i . 

The invest igatorfe drew the following' interpretations from the 
study: 

'i 

**Thls study shows that direct experience with objects can lead to 
increases in classification ability. Also these experiences art'^nore 
relevant for VI and CD children than for MC children. On all of the 
^easures used in this study VI apd* CD children had a^ni^af scores. 
One ^explanation of this similarity in scores is that both groups of 

^ children come from experientially limited environments. Thus, these 
results support Plage t*s theory that logical thinking, which includes 
daasificatory ability, is fostered by interaction between the in-- 
dividual and his environment, Turtbermore, direct experience with 
objects was effective in increasing the classification scores of 

^ children' from limited environments more often than it vas effective 
in increasing the dass^lcatibn scores of children from middle class 
environments. This indicates that for six^and seven-year^-old children 
y who initially score below the WC level , a relatively small amount of 
directed experience cto bring them closer to the MC add in some ca^es 
up Xo the MC level." 



Abstractor's l^otes* ' 

This ihvesti^ation is one of a large number* which needs to be 
conducted to detarmlne the viability of theories which attempt to 
explain how children learn — in this case, attention is given to 
pa^ts of Piaget's theory. 

The study does support parts of Piaget*s theory. However, as 
th% authors indicate, neither intelligence nor age was strictly con- 
trolled in tlv^ investigation &Ad therofore the differences between 
groups are opeh to 4gue8tion . ^ In any case, the ^dif f erences within 
groups* do support ♦Plaget's tho<fry, 

In interesting question ^cu^se^ d<ie to tHe me^thod of selecting 
classes for the study^ The Qritetia for selecting classes were 
<1)' the^ teacher 's rerpjitation'. pf exd^lle^ce as described by her peers 
.and supervisors and ($) classroom obsez^^ions that iqd^-cated children 
w^e giveA freedom to' explore wTthija the cur^ctilutj atryctur?. That 
question ^s^ ^"Was the lack oi^if fferenc^ wit win thV experjLntental MC 
groups on eafpeVimelit one complet;^y*or pajftially attributable to the 
datura of learning 'exp^eHenc^s oXiea^y present 'in their classrooms?** 
And, if tjie ax^swer t|0 'Uoa 4t*G8tjioA».i8 .'lyAs''*;" 'Vhat were the nature 
of those lehn^lng experiences jf*^ * , ^ 
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Because there were no control classes for experiment two. It is 
not clear that direct experience with objects was responsible for 
the Increase In score on the post test. It Is posWble that other 
types of experiences or "that matur atlo n^alotie wiiii account for the 
Increase In score* '^'^ * 

&Jridence from' this Investigation indicates thlat MC children have 
skill in classification before having direct experience with objects 
in the Material Objects unit. The evidence also indicates that 15-20 
hours pf direct experience significantly Improve classification skill 
of CD and VI students although .they remain less skillful than MC 
students. There is some question, as the investigators indicate, 
whether the CD and VI, students have fewer opportunities to interact 
with the environment than MC students have Or whether they have 
qualitatively different interactions with the environment than do MC 
students. Thus, it might be* that the kinds of direct experiences 
provided^ in Material Objects was more Important than just providing 
direct experiences in raising the posttest scores for the CD and VI 
students, lb Experiment 'One . 

^ In experiments such as those conducted, one is often tempted 
to;' wonder whether or not the pretest is a significant contributor 
to any Incre^e in scoxe on , the posttest* Thi^ is one area of in- 
vestigation which might be cons'ldered more often in many research 
projects. \ 
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^ The pulrpoS^ Of this Investigation vas to determine We effect of 

* two types of post laboratory discussion strategies on sixth ^ade 

students' learning selected^ ddence, principles. Both .strategies * 

ii^volved children reporting th^elr obseryatltjns to .the-^tiliiss.' Qn^ 

strategy elicited Inferences frpm stud,iaiats By pointing; ^ut conflicts 

'in their observations (Brpbing i:€Sclinlque) \diexea8 teathers* using the 

other strategy ^explalne<i the observations to the claas (NOijprobing 

Techniques) J ' ^. ' . j^' - 

' . ' ' ' • ' ' 

r ' ' . ... • 

Rationale ' , , - . * ^ 

\ • % _ ' 

, This stndjr,ls ba«ed on the Piagetlatt^theoty that. In oxSer to 
acqiilre knowledge,' ther6 must be., active interaction between a leam«r 
and his envitoni^ent.^ This involves direct experience .<tlie laboratory 
ai>proach) and a mentally Active lejarpar Ua can be obtained through 
peer interaction utili^iiig Cognitive cpnf llcta^ of Smedlund and Inquiry 
Ttalnltig procedures 6i ^uclman), .^epce^ acdptSiing to both lPlaget,and . 
^runfeir,' tioth laVorato^ ^pet^enc.e8"*«da discussions are important in 
.learning. \ * ^-'"-X' ' ' 

'y- " \^ ' * / . ' i 

. ^It lias been Nels^'q observation that many teacher;^ ^o are ualng^ 
thi* ntew science Currl^lS^ fail to utilize discussion, techniques after 
the labor^torj^ , activity has been completed to brings about acl)lev«nent 
of thel' -program objectives. The post laboratory discussion frequently 
invol'^^es reporting of the observations by the students and conclusions 
by the teachers during which time the thlldran are pass'lve. If after 
students report their observations, the teacher elicits Inferences 
from the children by pointing tfut conflicts in their observations,* the 
children ^ould be more mental]^, active and iSore learning should occur. 

Research' Design and Procedures 

The spmpU conBls^ted of eight classes of sixth grade students in 
two Philadelphia area. schools • * One of these was classified .as urban 
(M.A.*« 82) and th^ other as surburban (M.A. " 111). Two uni^ts frtwn 
the science program (which consisted pf topics suitable for e^ixth grKde 
i^udenta tad which were designed to provide practice' for students with 
the proems ^klllsX wqre* selected for the teaching of the science 
principles'. Classes ^tr^ taught for thre^ forty-five minute periods 



per week and the teaching of the selected principles did not occur 
until six weeks after the experiment began. In order to measure 
student learning of the selected principles, two multiple choice-type 
tests based on the objectives of the units were constructed. 

The units were taught by two experienced teachers. Each taught 
four classes (two In each school) using each strategy. Strategies 
were randomly assigned Xo classes. This resulted In a 2 x 2 x 2 
factorial design with teacher, school, and strategy as the factors. 
Data were analyzed using an analysis of variance with fixed factors. 
Claasrflfcms were considered the experimental unit. This resulted in 
using class mean gain scores for an analysis of variance with one 
observation per cell. Because of this, the analysis utilized the 
triple mean square as an estimate of the variance of group means. 

The two strategies which were used in the classes were broken 
down into three stages. The probing strategy consisted of a data 
gathering phase, a data processing phase, and a verification phase. 
The nonprobing strategy consisted of an identical data gathering 
phase but this was followed by two lecture phases. In order to assure 
that the treatments were applied as designated, the Classroom Obser- 
vational Record (COR) was employed to determine the extent to which 
each post laboratory discussion strategy was used. Data were recorded 
for four observations (visits) of each classroom and analyzed by a 2^ 
analysis of variance. 



bindings 

Analy^l^^^b<^he COR data, revealed significant differences at the 
0.01 level in the direction implied \>^Ji^ discussion strategies (tables 
were not reported for this analysls)^f^15r addition, the data were 
examined on the microscopic level for the frequency of occurrence of 
behaviors associated with each type of model and were then analyzed by 
chi square. This analysis revealed that the probing strategy used 
significantly more data processing interaction, whereas the nonprobing 
strategy had significantly greater lecture and data gathering inter- 
action. In the case of verification, however, the probing technique 
had only one Interaction as compared wit^ zero interactions for the 
nonprobing technique, therefore, the strategies did not differ in this 
regard. . , . 

Class mean gain scores showed no significant correlation with ^ 
class mean pretest scores, lending support to the Inference that regress 
ion to the mean may not have affected the outcomes. An AKOVA performed 
pn the class mean gain scor^ revealed a significant difference between 
each strategy which favored the nonprobing strategy. The factor "school 
showed the suburban school gains to be significantly greater than the 
urban school gains. 



Interpretation 



This study suggests that the type of the post laboratory discussion 
.affects the learning of science principles. In using a probing strategy 
not as much content can be covered in the same amount of tl;ne as in 



classes taught by a nonproblng strategy. (In the probing classrooms 
students heard at least four applications of the principle whereas In 

the nonpr oblng classroom only one or two applications wei;e discussed.) 

This may have been the reason why the nonproblng classes achieved 
significantly higher on a Science principles test. 

The study also Indicated that children In the Inner city school 
achieved significantly lower than did children In the suburban school. 
This may be due to the nature of the test. Bven though the test was 
read to the students so that the urban children would not be penalized 
due to lower reading level, the students may not have understood the 
meaning of the words. A correlation at the 0.05 level between mental 
ability scores and the test gain scores Indicated that gain may l>ave 
been due to mental ability. In addlh^^on, suburban children may have 
been more motivated to do well on testes. 

This report suggests that the newer elementary science curricula 
which stress the products and processes of science cannot both be 
gleamed using the same discussion techniques. If the primary emphasis 
Is to teach prlndpl^^ a nonproblng technique Is to be preferred. 

Abstractor/ s *Notes « 

Severail features of the study were excellent. It appears to have 
been very well designed. 

1. It was conducted over a long period of time (11 weeks). This / 
allowed classes to become adjusted to the discussion strategy. 

2. The teaching was don^ by, the same two teachers in two different 
schools, that is, urban .^d suburban. This eliminates teacher 
effect* and allows bne totj^^look at the effect among children of 
different socio-economic\^backgrounds . 

3. Care was taken to assure, that the treatment was actually 
occurrlxig in the classrroom through the use of the COH and 
analysis of the observations. 

, Several areas were excluded from the reporting of this study which , 
would be of interest to the reader. 

1* The absence or presence of homogeneity of Variance is not 
noted. There might have been a ceiling effect on' the test 
for the suburban children. 

2. The actual pre and posttest scores , were not repotted although 
the class gain scores were. It might have been interesting 
to examine the pre and post scores o^ the urban tnd suburban 
children in order to examine relative gains. 

3. The handling of the missing data was not Ihduded. Absentee- 
ism is frequently higher in urban settings. If this was the 
case and these data were omitted from class meanS, there may 
be even a greater difference between urban and suburban scores 
than was reported* 
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Th^. statlttlcal design of the stbdy was^OVA with strategy, 
teacher, and schoQl as fixed factors. Because school and teacher are 
considered as fixed factors In the analysis, care must be taken In 
generalizing to other teachers and schools. 

In addition, the study could have been Strengthened by Increasing 
the number of observations per cell to more than one. This would have 
resulted In not having to usfe the triple Interaction , mean square for 
the analysis and one would pot have to be concerned If 'the assumptions 
for using this method were met. 

Although the author states that "there may be many factors* yhlch 
led to lower mei^ gains for urban chlldrei\ than* for suburban children, 
replication of this study In which mental abllltpr Is used as a covarl- 
ate may answer the question. There Is an average 30 point difference 
in mental ability between the two groups. Perhaps fa. study of these 
two strategies In a suburban school between high and low mental a})lllty 
children should be undertaken. 
<• 

One of the reasons given for difiCoyery Ibamlng is that children 
tetaln information and principles more than when children are taught 
in a didactic manner. This study d6es not set out to answer the 
question of how children wpuld retain the J>rinciple8 according to ^hich 
type t)f post .JL4bor,atpry discussion they had. The answer to tljis ques- 
'tioft is' it more educational significance than are ,the Immediate outcomes. 
AdditioniLL research in this area should investigate long term effects. 
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Ring, Donald G. and Joseph D. Novak, **The Effects of Cognitive 
'structure Variables on Achievement in College. Chemistry 
Journal of Research in Science Teaching . Vol. 8, No. 4:325- 
" 333, 1971. ; . 

Descriptorsp*Chemistry , College Stience, *Cognitive ProcesLses, 
*EducationaL Psych|/logy, Educational Research, *Leaming 
Theories I 

I " ' J -J- i 1 

Expandec^ Abstracted Analysi^ Prepared Espiecially/for I.S.E. by 
Heidi Kass, Universit^of Albferta ; 

• " J n ' './ J 

A / 

Purpose y / 

• j 1 ■/ I 

The study det^iliilnes the relative influence 6n facts and sub 
sumliig concepts possessed by beginning college chemistry students of 
subsequent- achievement in a chemistry coiirse. 



Rationale 

Aualttbel's model of meand^^gful verbal^ leimlng provides the 
theoretical framework for the study whidi fopucles on the assimilationy 
of new information into existing cognitive strlfte»ij:e. The premise / 
tested is that existing cognitive structure facl^iitates the learning 
of new material to the extent that it .provides /ie relevant Subsumers 
for the new material.' The study was ^sjgned so^ to meet thc^re- 
of'Ausubel's long-term transfer par«pim. ' / 



qui^ 



rements 



Research Design and Procedure 

A sample of ^0 st\fdents enrolled in tTfeir first course in 
'college chemistry at Cornell Unive rsity Was administered a Cognitive 
Structi^e Exam (CS Exam) prior 'to Instruction in order to »detcrmiive 
the levels of prior factual knowledge and subsuming concepts of ead^ 
subject. The CS Exam consists of twenty-six items selected frocaa " 
^'Test of Specific Course Objectives" prepared by Educational Testing 
Services and revised by th^^atl^'Kors • Items /meafturin§ the presence 
of information considered to be feomewhat arbitrarily related to Con-^ 
cepts in chemistry were categorized as fact items. Items requiring 
comprehension and/or application of chemical concepts were categorized 
as subsumer items. Split-half reliabilities with application of the 
^Spearman-Brown formal^ yielded reliability coefficients of 0.51 for 
the fact items, 0.67 for the subsumer items, and 0.90 for the total 
test* 



The depc^u||nt variable of chemistry achievement was 
score consisting of the sum of the individual test {(^ades 
by the subjects on tests devised by the GeneriCi. Chemistry 
^kJttiell and administered at periodic interval^ as the 
Sressed. Type of high school chenvLstry preparation, SAT 
selected attitude measures were obtained from student re 
from a qOestionnalr^. 
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Analysis of covarlance was used to compare hl^h, mediutn, and 
low fact groups on chemistry achievement with SAT Verbal and SAT ^ 
Mathematics scores as covariate^. The procedure was jepeated for 
high, medium, iand^ Irw subsumer groups. The interaction of fact and 
subsumer pretast performance on achievement was examined by analysis 
of variance walch compared the achievem^t of a group of Subjects 
who had hlg^ tact<*hlgh subsumer scores -or low fact -low subsumer scores 
with a group who, had either high fact- low subsumer or low fact-high 
subsumer pretjast^ scores* 




There 
lowled^e 
^hip be^eec 



r 



as a significant xelatlonshlp between pretest factual > 

course achlevelaent. There was a dlgniflcant relatida-: 
the extent^ ol prior existence of subsUmers ox organi^iilg 
Concepts ^In I the cognitive structure ai^d course, achievement. A signifi* 
tant int^raation betweep fact and substmier performance with respeit^ 
po subscqueiit course achievement was found* The i^resence of a high| 
level ok facts in conjunction with relatively few^organiz^g concepts 
had litttle llacilitating effect on subsequent course achievement. 
HighesL achievement occurred when both a, high number of^fapta^ and a 
high xfimS^r of subsuming concepts were present* 



Interpre tations , ' ' 

The 'findingfi^ support Ausubel*s theory of learning in .t^j£^he 
facilitating effect of facts on subsequent learning of new course 
material Waa dependent upon the presence of organizing co^epts or ! 
subsumers* Factual knowledge in Itself does little t^4^craase the 
efficiency of subsequent learning as in the absence of reliev^t sub-', 
sumers new material is processed as rote information* A highi^vdif- 
fefentlated cognitive structure in which both facts and concepts t^e 
present is optimal for subsequent learning. ^ 



I' 



Abstractor's Notes 



It is difficult to 'refute on common sense grotmds alone that 
what the learner already knows about thh subject is an important 
factor in determiniag his performance In subsequent learning of the 
subject* In other words^» earlier success is a good predictor of 
lat^r success in a given domain. Since the students in the 'sample 
had already experienced some delgree o^ aucceas in their high school 
che^3try and possessed a knowledge of chemistry aji least sufficient 
to t^ualify them to enroll in a college chemistry course, one may 
suglgest that the role of concepts vs. facta in dubaequent course 
achievement may dej^end, among other things, on how new the "new" ^ 

, material is in relation to the basic principles of the subject. In- 
troductory undergraduate chemistry courses of ten deal with "topics 
Introduced i^i high school. Thus the fact-concept selection and 
relative emphasis of the course and its achievpment testa^ and simi- 

► lai^ity witl\ the fact -Concept ^phasis in previous instruction may , 



r 



-.1 i 



so 



influence the relationships observed. For example, students with/ a 
good mendry may and often do perform well on chemistry tests with a 
high recall component. 



This raises the queistion of the point in learning a subject ^t 
which systematic development y6f concepts should begin. Studies timi- * 
lar to the above conducted both the initial stages and more advanced 
stages of learning a subject could be revealing. What is the nature 
of a relevant subsumer for students introduced to a subject for the 
first time? Is it a verbal passage at a higher level of ^abstraction 
t6an the material to come, or is it a concept from the subject? If so, 
what sort of a concept, and yhat should its ^relation be to the facts, 
if any, at hand? Could an analogy function as a subsumc^^? Ring and 
'Nbvak use "subsumer^," "subsulning concept," "organising concept" and 
'^concept" interchangeably and, from the example given i seeto to mean 
the^concepts and principles |of the subject matter. The. work of Plaget , 
and others suggests that certain logical operational scHtma may also 
serve as cognitive structure variables or subsumers indepeVvdent of the 
specific subject-matter. ^s^^ 

The fact-concept relationship itself warrants' further examtoation 
not only from the inductive vs . . deductiye Mpects of their^ presenta- 
tion to^^earners but also from the standpoint of establisl>ing ^he ^ 
Aeaming consequences in terms of variables such as efficiency and 
retention of various combinations and proportions of each. Depend- ^ 
ing on the ifcpict knowledte of certain "facts" could make Icariolng 
more effl^cl^t. In introluctory chemistry most students learn quite 
quickly fh^ "fact** that the atomic, weiglit of oxygen is 16 .00 -because 
it is more efficient, in terms of its frequency of^use, to know^this 
than to^have to look it up every time its 'use is required: (The-vord 
"fact'*'*is in inverted commas because ^.t is not always easy in the 
sciences to^cstablish what is a fact and in what sense it -is a fact. 
As pointed out by, Schwab, a statement, about th€ properties of elec- 
.trons or neutrinos is not the same kind of statement aQ dne specify- 
ihg the color of the. car in front of the house.) jl 

The designation of a fact item aa one ascertaining the presence^ 
of information arbitrarily related to concepts in cognJI,tive struc- 
ture leaves the role of relevant facts, i.'e. ones which are relate^ 
to given concept^^in need of further clarification. Being able to 
write the correct electron configuration for magnesiuA tcAegorized 
as a fact item by Ring and Novak) may reflect the result pi arbitrary 
memorization of rules' for orbital filling. It may aisbj/however , be 
the consequence of possession of concepts or subsumers relating energy 
.aublevels, shapes and orientations of orbitals , »and electi^on spin, to 
atomic number. In what sense, then, are «Scientif ic concepts sub-^ 
Burners in cognitive structure? For example, ar^ relational concepts 
more efficient as subsumers for new learning thin constructs such 
as energy lev^ or atomic orbital? To what cxtfent is cognitive 
structure isomorphic with the structure of the subject? 

The implications for curriculum design "^nd kind of instruction 
of a more complete understanding of cognitive structure variables 
Such as facts and concepts may do something to resolvd the cycles of 
complaint that high* school chemistry programs are either too theo- 
retical or not theoretical enough. Does the student who can answer 
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coi^>Ie3c questions about solubility Products but is not too sure 
whet silver chloride looks likeinejfcaserlly heve the deeper under- 
stsnding of chemistry? . 
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Seymour, Lowell A* axid Frank X, Sutom^ "Critical Thinking Ability, 
Open-iUndedness , and Knowledge o/^the Processes of Science of 
Chemistry and Non-Chemistry Students." Journal of Research in 
Science 'teaching . Vol. IQ, No. 2:159-163, 1973. 
DesdWptors— *Chemlstry , *Critical Thinking, *Curriculum Evalua- 
tion,! *fcucational Objec^Ves, Educational Research, Instructional 
Haterlala, Sciqace Education, Secondary School Science, *Student 
Attitudes 7 



Expanded AlfBtr^ct and Analysljb Prepared Especially for X.S.E. by 
William Torop, West Chester State College. 



Purpose 



ited: 



Two null hypotheses* were te 

^1) "Experimental group one's post test score? will not be signifi- 
cantly different from their pretest scores on the tests ad^n- 
istered to measure critical thinking abili^, open-mind edness, 
and knowledge of the processes of sci«;^ce*^ 

2) "The postt|S8t scjores for experimental group one will not be 
significantly gi^eater than the j>ost teat, scores of control 
group two on th^ tests sdministered to ^asure critical think- 
ing ability, opf n-mindedn^ss , and knowledge of the p'rocesses 
of science." 



] Rationale 



[n 1968 the Chemistry Ouryiculum Committee of the Philsdelphis 
Hi^li: School District develo^d s guide for use by teschers in the 
iprthcnsivjt high schools. Aree dbje.ctives for the guide were to 
Beveljop critical thinking op tn -mind edness, and knowledge of the pro- 
'cessas of silence. This psroLcular study is related to previous 
inve^tigstibns by <^he documeifcstion of writers who considered these 
thra« inteJilectual sidlls to] 
instruction .V 



be worthwhile objectives of science. 



Resesrch Design and Procedure \ 

The experimental design appesrs to be the Solomon four -group ' 
design* Groi^p one was the "experimental group comprised of eleventh 
grade chc^mlstry students thst were pre- and posttested." Group t^o 
was the "control group comprised of eleventh grade non -chemistry 
students thst were pre- and posttested." Non-chemistry students were 
enrolled in all the s^ame types of courses as the experimental group, 
except for chemistry. The populstlon consisted of all eleventh grade 
chemistry students in 16 comprehensive high schools. The study Itself 
Utilized two represent stive comprehensive public high schools in 
Philsdelphis during the 1969-70 school yesr. The eleventh grsde 
studeQts in these two schools were slmllsr to the students in the 16 
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.schools in racial distribution and academic ability as measured by the 
pooperative School and College Ability Tests - Sexies II. 

* The variables were defined by the instrume;Qts used in this study. 
Critical thinking abiliCy was measured by the Watson-Glaser Critical 
Thinking Appraisal - Form open-n&indedness was measi|red by Rokeach 
Dogmatism Seala - Form E; ^and knowledge of the process of science was 
measured .by the Wisconsin Inventory of 'Science Processes. The results 
of pretesting indicated that there were* no significant differences 
between the experimental and control groups in initial abilities in 
the three variables. ' • 



Findings \ 

The results of testing null hypotheses' one and two concerning 
critical thinking ability led to their rejection at the 0.Q3 level of' 
significance. ' Chemistry students did' 'develop their ability to think 
critically |and were signif icantXy 'superior 'td non*chemistry students 
when post tested. 



Concerning openMninde^dness* null hypotheses one was not rejected 
and null hypotheses two was rejected at the 0,05 level. This indicates 
that chemistry students are more open-minded than non- chemistry students. 

With knbwledge of the processes of science, null hypothesis one 
was rejected and null hypothesis two was not rejected at the 0.03 level. 
Chemistry students did not increase their knowledge of the processes Of « 
8 cience . , ^ ^ ^ 



Interpretations * 

Critical thinking ability: The perccoitile equivalents obtained 
by abov^ average chemistry students in this stud^ were below the 
national valoi^s for above-average intelligence themist)^ students, 
more than hflf were below the 44th percentile. **£ven though instruc- 
tion in chemistry appeared to imp]K)ve the development of critical 
thinking,, there might well be additional experiences in school, espec- 
ially in chemistry classes ... to aid in this development." 

Oten-mindedness : Although chemistry students are mote open- 
mindedj than non-chemistry stijdents, the evidence is inconclusive i^s 
to whe|ther open^-miildednes^s is being developed through instruction in 
chemistry, following th^ guide. ^ 

Knov^lcdge of the processes of sciei\ces: The results of this 
study lead to the conclusion that the guide and its implementation 
totally fail in this4area. A re-examination of the guide, teaching 
methods and philosophy is suggested. 



, Abstractor . Notes 

The first problem was to establish the actual experimental design. 
The reference cited in the article^ Sax (2), is actually based on the . 
'blasslc Campbell and Stanley chapter in GAg^^^s Handbook (1). Even 
though a secondary source Is cited', the terminology, itself, does not 
indicate the true experimental design, used. The design was inferred 
from the fact that' the null hypotheses mention only experiiaental group 
one and control group two, as well as the section on definition of terms.' 
However, in describing fhe tfample selection, the authors refer to experi- 
mcati^jl groups one and three. This fits their statement concerning their 
determination and limiting of pretest sensitization i That^ls, one ex- 
perimental group was given the pretests while the other was not and one 
control group was given the- pretests while one was not, for a to^gl Of 
four groups: two experimental and two control. Although the authors 
state "only the results of two groups. are provided because of space 
limitations," reference to another group, two paragraphs later, leads 
to ambiguity. The Solomon four group design was finally confirmed by 
a telephone call to one of the authors (3) . , 

This telephone call also^provided the information that this study 
was only a preliminary analysis for research that has continued through 
the Israeli Science Teaching Center, Hebrew University, Jerusalem. 
However, there is no mention of this in the article Itself. / 

( 

While the two schools used in the study itself were sli^lar to the 
city average of 16 schools in racial distribution and academic ability, 
there is a great amount of individual variation between Individual 
Philadelphia schools in these two categories. Subsequent extrapolation 
of results to the entire eleventh grade population of the 16 schools 
may not be warranted. 

In a similar manner there appears to be the assumption that the 
Chemistry, Curriculuin. Guide was followed as written, at leaat in the 
two schools used in the study. There is no evidence to indicate similar 
experiei^tes for the chemistry students involved in the stud^.. The 
authors do suggest, for future considerations, examining tl/^ means by 
which the Guide is implemented io-the classroom as well as methods of 
teaching and the philosophy of the chemistry program itself 

The control group was described as eleventh grade non-chemistry 
students. However, thei^ is no indication given as to how much science 
they had previous to the eleventh grade or whether they were taking 
any other science courses that year. Perhaps the differences found 
result from a selection factor of these eleventh grade chemistry students 
who usually have biology in the tenth grade and physics in the twelfth 
grad^, and the lack of differences found result from a confounding 
of the chemistry variable by other science courses during the eleventh 
grade. 

It was stated in the article that "intelligence w«|8 measured by / 
the Philadelphia Mental Ability Test," but how the resiilts were used , 
was not repotted, at least in the article itself. Pretesting indicated 
that the groups were comparable in critical thinking ability , open- i 
mindedness and knowledge of the processes of science. , ' 



, Null hypothesis one w«8 analyzed and reported aa an F ratio, and 
null hypothesis two with a t-test. Frqp the article itself ,yirtriLch 
states the first null hypothesis as a comparison of posttest and pre- 
test scores for experimental group one, it would appear t^t a simple, 
repeated measures t-test would also be warranted. However, if the 
effect of pretest, intelligence, or some other factor is being con- 
trolled for in the statistics to warrant use of the F ratio, it is not 
evident in the article as published. Likewise, the synopsis reports 
that critical thinking ability and open-^ndednees appears to have been 
developed but only when pretesting was part of the teaching process 
(emphsis mine). It is Ainf ortunate that tjie repotted "space limitations" 
did not allow for amplication of this point. ^ 

Finally, the study lasted for just one semester, l^erhaps ^ longer 
time period, as well as other approaches of meeting th$ objectives of 
high school chemistry instruction, would produce more conclusive results 
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Purpose 

To determine what relationships exist between the level of cogni- 
tj.ve performance of students and their high school physics curriculum 
background (PSSC or non-PSSC) . 



Rationale 

Many attempts to evaluate the "new" science curriciila in the past 
have been inadequate due to the lack of criterion measures which are 
not biased toward the content emphasized in a particular curriculum. 
Backers of PSSC physics, a "new" curriculum, suggest that its use 
fosters the development of more complex cognitive abilities in students 
than do more conventional curricula. The work aone by Thompson and 
Schartz reports the CEEB Physics Achievement Test to be an appropriate 
criterion measure for both the content of PSSC ind non-PSSC curricula. 
This test includes items requiring students to perform at the Knowledge, 
Comprehension, Application and Analysis levels pf Bloom* a Taxonomy of 
Educational Objectives-Cognitive Domain* The students* responses to 
these items t grouped and scored by leVels of cognitive performance, 
should provide criteria for characterizing the similarities and dif- 
ferences between the PSSC and non-*PSSC students. 



Research Design and Procedure 

This study was designed to test the following hypotheses: 

f 

a. Relationships between academic aptitude ^d performance 
at the Knowledge k Comprehension, Application «nd Analysis 
cognitive levels . are not dependent on the type of high 
school physics bil^lcground. 

b. Students with non-PSSC physics background will score 
higher on the Knowledge level criterion than will the 
PSSC students. 



c. Students with PSSC physics background will score higher 
. on the Application and Analysis level criteria than will 
non-PSSC students. ^ 
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Two samples of 370 e^cb were drawn from a list of physiq^ students 
vbd had completed Form lAC 2 of tbe tKEB Physics Acbieirement Test. One 
sample yas of students with a PSSC physics background a^d^ the other 
sample was of students with a non^FSSC physics background. .These samples 
were further reduced by the scalability of Verbal and Mathematics SAT 
scores. The resulting samj>^ were PSSC background » 369 and non-PSSC 
^ bajlkground • 359. ^ 

The CHEB Physics , Achievement Test items were independently classi-^ 
^ied b*y two individuals into the following performance levels: Know^ 
ledge -^9 items > Comprehension - 17 items , Application - 26 it^ms» and 
Analysis - 23 it^ns* The interrater agreement wets 66 percent* Kelia- 
billties'fpr these subscales were not reported. 

Correlatit}ns between the SAT standardized scores and each ^^f the 
cognitive level subscales were computed)^or each sample. Test^foj 
group differences in FJLsher Z transformed correlation^ were made. 

Analysis of i^ovariance as developed by Wilks and. Gull^^on was 
used to test for difference in Cognitive performanqe at each of the 
four levels « The SAT score was \ised As the covarlate. 

' . ' / - - ■ 

Flndlngfl 

a. The PSSC sample and th6 non-PSSC sample were not equivalent: 
in terms of the Verbal andj Mathematics SAT scores . the . 
, differences f*vored the PSSC gro'Up at the 0*01 I'evel* . 

\^>^ ^« The SAj scores^orrelatied positively with performance 

the cognitive level criteria/ These relationships did not 
differ significantly for PSSC and non-PSSe* groups. 

c. The analysis of covarianc/e produced' the foUiawlng* result^ : 

1 ^ ' • : 

1. The cognitive level criterion » Comprehension , did 

not satisfy the assumption of homogeneity of vari- ^ . 

ance at the 0.01 lev^l. 

2. The cognitive level criteria » Application and Anal sis , 
, ^ did not satisfy the asstmiption of homogeneity of 

regression at the 0.01^ level. ^ ^ - 

3. The cognitive level criterion » Knowledge » resulted ' 
in a difference favoring the non^PSSC group. 

4. The cognitive level criterion. Analysis » resulted in 
a difference favoring the PSSC group. 

Int erpr e t at ions , 

Scholastic ability is equally Important as a determinant of ^\ 
performance at the various cognitive levels for both PSSC tnd t)on*\ 
PSSO" Students. , The investigator rlndicabes that if the PSSC materials 
foster the develppment of more complex cognitive abilities than do the 
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non-PSSC materials then the correlations of SAT scores with the cogni- 
tive measures sKould be leas In the PSSC group than in the non-PSSC 
group. 

The PSSC students performed significantly better on the higher 
level cognitive process measures. The investigator states that since 
thl? finding would be expected on the basis of the stated philosophy 
of the developer,s of^tHe PSSC curriculum, it could be concluded that 
the "new" physlca curriculum was Toaore effective in developing the 
higher cognitive skills than were the more traditional curricula. 
Altjieugh these differences were significant, the adjusted means dif- 
f^ed by less than one point . The investigator concludes that both 
the PSSC ^d non-PSSC curricula tend to develop the higher 
nitive skills. 



Abstractor's Notes 

It 19 difficult to know how'anuch faith to place in the measures 
of cognitive level performance used in this study. The rellabllitiea 
o^ the subscales created from the CEEB Physics Achievement Test were^ 
not reported. These subscales ranged from 9 items to 26 items in 
length. ^ The raw score means indltated that the average scores ranged 
from 26 percent up to 51 percent correct. Neither group did very well 
compared to the performance possible on the criteria. The difficulties 
that were experienced in meeting the assumptions for the analysis of 
coyariance also may mean that the critisria should be examined more 
carefully. The adjusted means for these scales were not included in 
the report. It would be useful to have them since the differences were 
,in terms of the adjusted means. 

The conclusion that PSSQ instructional materials were ^pore effec- 
tive in developing higher cognitive process skills is .one way of 
accounting for the results reported in this study. The validity of 
this conclusion depends on a niimber of othet conditiona. 

It vas shown in the study that the samples of PSSC students and 
non-PSSC Students wereldif ferent in terms of SAT scores. This suggests 
that the populations represented by^ these aamples were nqt equivalent 
for at leaat one characteristic and, inost likely, there were other 
differences not detected^ by the investigator. The, higher 'cognitive 
processes such as Application and Analysis correlated about 0.60 with 
SAT scores and accountedi f or 36 percent of the variance.. The Remain- 
ing 64 ' percent was assumed to be a measure of the performance at the 
specific cognitive level of interest. The investigator had to assume 
that ho other initial differences in the groups were responsibla for 
the Results oi th6 analysis of covariancel Since the PSSC group had 
higher SAT scores it is prpbable that they had other cognitive per- 
fbi^mance abilities to st^rt with which were independent of those 
?»a»jired by the SAT. In short, the differences in the scores of tie , 
PSSC and nort-^SsC groups on the Analysis cognitive level may have 
been there bel^ore the atudents took physics. 

The types of communities, school^, and teachers which select ind 
use PSSC materials may have more to do with the results than did the 
curriculum used^"^ If the kinds of skills supported by the vriters of 




PSSC materials are valued and considered relevant by the teachejrs and 
others who make curricultxm decisions then they Are apt to select the 
PSSC materials for use. Students in schools where PSSC materials are 
selected probably already possess a higher degree of skills related 
to performance at the higher cognitive levels. ^ 

This study is a post-hoc analysis and the results should be 
treated as such. The Investigator has concluded that "the results 
essentially supported the position of new curriculum writers that 
the PSSC Instructional materials were more effective in ,d|Sveloping 
higher cognitive process skills." There are- other altevnative claims 
and explanations which can be supported by evidence in this study. 
The data in this study are correlational and the causal .inferences 
drawn are unwarranted. , » » - * 
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Wolf son, Morton L., "A Consideration of Direct and indirect Teaching 
Styles With Respect to Achievement and Retention of Lea'mlng In 
Science Classes.** Journal of Research In Science Teaching . 
Vol. 10, No^285-290, 1973. \^ 
Descrlptor6^*Academlc Achievement, *Interactlon ProCes? Analysis, 
Centlon, *Teacher Characteristics, *Teachlng Styles, Chemistry, 
Educational Research, Science Education, Secondary School Science, 
(Research Reports) 



Expanded Abstract and Analysis Prepared Especially for I.S.E. by 
Ronald D. Apderson and Kenneth D. Hopkins, University of Colorado. 



Purpose , ' ^ 

This study was undertaken to compare the Flanders l/D ratio of 
, selected general science and chemistry teachers to thMr students 
achievement and learning retention. 



Rationale . • • 

Studying teacher characteristics or the teacher *s behaviors In 
the classroom as a means of learning what will ensure student learning 
Is Inadequate. The teadbier-student Interactions In the classroom must 
be examined. In addition to simple achievement, retention must be 
Included as on Indicator of student learning. Research Is needed which 
relates pattfems of teacher -student Interaction to the student *s short 
and long term learning. 



Research Design and Procedure 

Eight high school chemistry classes and six junior high school 
general science classes from oi^e Suffolk County New York public school 
system were Include^ In the study. No basis for the selection of these 
particular classes is given. The study la correlational in nature 
with no experimental treatment Involved. The Flanders system was 
employed to code the classroom interaction twelve times during the. year 
in general science and nine times in chemistry. In all classes an « 
achievement test was given at the end of the school year in June and 
the samotest was given tQ the students again four months later. The 
achievement test used in the chemistry classes was the New York State 
Reg^ts examination and the one used in the general science classes 
was the College Entrance Book Company exagplnation. No information on 
the reliability of the tests is provide^ The scores from the first 
test were used in the analysis along with retention scores which were 
based on ratios of the retest score to the first test score fpr each 
class. i 

4 

Apparently, the fourteen classes involved in the study were taught 
by eight different teachers. For purposes of analysis it appears that 
the scores from all of the classes taught by a given teacher were con- 
solidated and the analysis was done by teacher rather than by class. 
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Analysis of variance was used to determine If the achievement scores 
of the students taught by the various teachers differed significantly . 
from each other. The analysis was repeated using the retention scores. 
The Duncan New Multl^^e Range Test was used to compare means after the 
F ratio was found to be significant In bbth analyses. 

Further treatment of the data was based on the apparent post hoc 
finding that two of the chemistry teachers had rather high I/I) ratios 
and two had rather low l/D ratios. The same pattern of two high and 
two low X/D ratios was found for the general science teachers. 



Findings 

Use of the Duncan New Multiple Range Tesf^or comparison of means 
showed that In all four of the comparisons of a high l/D teacher with 
another high l/D teacher and Of a low I/D teacher with another low l/D 
teacher, there was no significant difference In the means on the achieve 
ment test. In the case of the retention scores three out of four such 
comparisons of low X/D teachers with each other or of high l/D teachers 
>^al|u^each other were not significant. VHien looking at the various com- 
pi^^Bons of a low l/D teacher with a high I/D teacher,, six out ol elghjt 
sutiih^ comparisons showed significantly different means on the achieve- 
ment test and eight out of eight such comparisons showed slgnlf Icanily 
different means on the retention score. The direction of these dif- 
ferences was In £avor of higher student scores for the teachers with 
higher l/D ratios. 

/ 

Interpretations 

The author concludes that In chemistry or general science, students 
will achieve higher scores 6n an achievement test and on a retention 
test If they are taught by a high l/D teacher. He Infers that the 
"flexibility" of the high I/D teacherp (their I/D ratios were found to 
vary more from one time to another than those of the low I/D teachers) 
may account for the differences In achievement and retention of the 
students. Since greater differences had been found In the retention 
means than In the achievement means he speculates that the retention . 
test may be more sensitive to differences and thus the retention test 
Is perhaps a better Indicator of learning. 



Abstractor *s Notes 

This report proj^des an example of research In which the Investi- 
gator had a viable purpose and collected usal>le data yet failed to 
publish an adequate study due to faulty data analysis and Interpreta- 
tion. It has several serious defects. 

The study Is Improperly Interpreted; cause~and-ef feet conclusions 
are drawn where only an association Is warranted, viz., (p. 289). 
"Furthermore we can conclude that students of teachers with a lower 
I/D ratio." But could It not be the other way around — higher achiev- 
ing students /and classes cause teachers to be more, encolrag^ng In their 
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re»p9n8cs to the c^lass? WolfsotiL i^lpllitesf 0he lof the ia6sr elenjpntai 
re^e^rch axioms, correJUtion' does QQt negcessa^fXy wan causation. ' * > 

^ A •related 'problem results from thfc studyfs failure to rule out 
'Compelling selection 'thre^ ts* to > the inteyrtial Jfalidity . > AJj^st^cer-.*^/ 
^ 'tainX:f the fitXasses wefe net eguiX, ia IQ, soc'lfe.-e(!8Scmic sr/itus and 
maiiy^* other variables :fer;^d to sciooce achi^ement. T6 diirt^^ard all 
but*che.r/!) class differences in explaining Achievement, differeAtes, 
aawngivuj^e classes,,^ n^t*jui^ Th^ ^study coultJ haye^ increaJie^ 

,^'it;fl c^edflbJiity greit^tyhi^ <J»i>^x9f. two toea^SiA^ful variables, su^h as«.„ 
*IQ or standardise^ atJiievement fi<:pit^ /-been uded as covarlates* 

A third seribus ve^kness results t^om in improper applic«ti<nx' of 
ANOTA. .Classes are a> Yfedc^a factor, i.e., t^fe inyastigatoV desire* to 
disc6yer la finding gener^irabie to other classes lU<e the; ones, in ,the„ 
study. The fSced^ effect of interest's the I/D 'level! .pie analysis 
is oblivious' to this' fundamental distinction ani hence do^s^AOt directly 
,,«nsWer the researcher's, quest ion". But yhrft^are .tl>e consequence©*? ^ The 
■ 'an4iysis should h'ave reflected the in^licit hicratcKic^jl design tVe 
I/D cXwsificati^^ (high or low*) , t^ie class facCor neste^*.^thin I/I>7* 
and pupils nested t*i^h4n class.. The'.correcjt analyjsis wouidluse t;he 
" mean squajfQ for classesnt^ithln I/D level as ,^the pi^opei;^ denominator for 
4.the,F-test comparing the means of tlje high and low." I /C groups., Thle , 
F'-yratlo would require an, enormous cri^icai F-value since ifbere would 
only be7 2 jiegrees of fre^'dinii in the 'Si5&0T tftrm. If ' thel^5 v^k no sig- 
.nif leant dil^fisrences jSbcween clii^es *witfiin category, the Sir *nd 
df from classes .vitliln I/D igvel and pupils within, class could be , 
pooled ^ to yield' €tti,"ef ror te^^^ji^h.tt^^i-PPWM. An "eyeball examine- ^. 
tlon" of tbe^ineans Suggests XhsX thttslattet aituation probably pertains^ 

'Wolf son performed a', one factor ANOVA complaridg the four passes, 
'Which cb'nfounds l/H ^ith claims ef fects. He thpi proceeded to takWe 
multiple comparisons' ^Among^ c^^se? to %Ack into*' Inferences regarding,. 
Jvlgh-low I/D differences. ^Multi^le comparisons ate neyei^ *appropriate 
with ''a random factor such as "glasses >'Vu\r ijultiple coiApaxlsf^n \^uld 
, have bsen' unnecessary had the Rrpper hierdV^l^al dnaiytils been^ 
employed since only^t^ meaiis f6r the^I^D effecVjouii^ve been \^ 
involved". • ^'J ' , . ' - • . • 

TarentlietlcalXy jit can io^ noted th^ the Ihincan HurcJ4»^e compari- ^ 
son Technique 1^ a poor choice e^yen if -itfiltiple cdfirparisons had^l^een 
injorder» With The Duncau technfque varies depending on tl^e number 
of means il>«^the s%& being ex^ined.' ^}tith fouf - means with ai^^p^re^t ^ 
Jv.'.of .05» the actual, cC is 4^14 x^en "^^bmparing tho^most ext^^oe ro^.anir^ 
RareiST^does ajresearchet^want tV- reject scft^^ mean dirf f erengf^s'^'iit***' * 
much m6rci relaxed type -I ierror piiiib ability th^. others 



. he does, ^ht^ wants' to cont'fol X , 'somettiing he'tannot do 
^tXjncan. teglmique. " t 



Several ^tWLnox protjlems dei^crve mention. Hp .inf brm4tioij is given « 
^ as to' how ^e CiJtf^l nUmlier of ^^ydents^^as reduteti..to 1^(^ or ^Vhy there « 

were yet 168 in the ^OVAL (fable .X^H) • llav^ many cases were losft 
^ "between the posttest and dt^layed* ;po^ttQst ^Vujr mdfiths Xater? Tli* .. ^- 
^ V sa|[iple ii inadequately 4e8<^fibed which limits' the atuSy bf external* } ' 

yalidity; no information is given regat^llng ethnicity, ifoclo-ecOnomliU 

. \-: ■ f. • • . , 
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Status, IQ, or sex* Is^resslonistld Infoxmatlon Is consldersbly 
better thsn no ^sts at all. | t 

The manner in which the retention test^vasfhandleid leaves much to 
^ jdesir^ The ratio used allows regression effects to confound the 
dependent variable and hence reduces its reliability. Covarying the 
end-of-year test or using a. repeated qiysureb an^Q^sis would have been 
preferable. ! 

The investlgator"coui4 have increased power and obtained direct 
information on Aether science content (clbemistry or general science) 
interacts with the l/D factor by converting scores Qn both tests to 
standard scores and ^employing all observatilons the saine analysis. 
The three factor de8iga«<then would be science content by ^/D level, 
with classes nested within l/D (and pupils nested within the three \ . 
factors) . Exainination of the interaction of l/D level by science con- \ 
tent would indicate whether or not the difference in high and low l/D 
levels was generalizable across chemistry and general science. 
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